-- Logs begin at Tue 2022-05-10 13:09:55 UTC, end at Tue 2022-05-10 14:27:13 UTC. -- May 10 13:52:28.915638 dv-cinder-835881-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 13:52:28.924369 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 13:52:28 2022] *** May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: nodename: dv-cinder-835881-9-iscsi May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: machine: x86_64 May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: clock source: unix May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: pcre jit disabled May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: detected number of CPU cores: 4 May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: current working directory: / May 10 13:52:28.926611 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: detected binary path: /usr/bin/uwsgi-core May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: your processes number limit is 47680 May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: your memory page size is 4096 bytes May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: detected max file descriptor number: 2048 May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: lock engine: pthread robust mutexes May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: thunder lock: enabled May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 13:52:28.927303 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 13:52:28.975512 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: Python main interpreter initialized at 0x55f1bac409c0 May 10 13:52:28.975512 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: python threads support enabled May 10 13:52:28.975512 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: your server socket listen backlog is limited to 100 connections May 10 13:52:28.975512 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: your mercy for graceful operations on workers is 90 seconds May 10 13:52:28.975938 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: mapped 403077 bytes (393 KB) for 2 cores May 10 13:52:28.975938 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: *** Operational MODE: preforking *** May 10 13:52:28.976243 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: *** uWSGI is running in multiple interpreter mode *** May 10 13:52:28.976243 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: spawned uWSGI master process (pid: 102646) May 10 13:52:28.976462 dv-cinder-835881-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 13:52:28.979548 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: spawned uWSGI worker 1 (pid: 102647, cores: 1) May 10 13:52:28.979548 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: spawned uWSGI worker 2 (pid: 102648, cores: 1) May 10 13:52:28.979548 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 13:52:30.337293 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:52:30.396677 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 13:52:31.076562 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:52:31.076562 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: from cryptography.utils import int_from_bytes May 10 13:52:31.076877 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:52:31.076877 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: from cryptography.utils import int_from_bytes May 10 13:52:31.128752 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:52:31.128752 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: from cryptography.utils import int_from_bytes May 10 13:52:31.129007 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 13:52:31.129007 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: from cryptography.utils import int_from_bytes May 10 13:52:33.703333 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:52:33.704005 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:52:33.704102 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:52:33.704180 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 13:52:33.704526 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 13:52:33.704628 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:52:33.704710 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:52:33.704908 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 13:52:33.705053 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.705268 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 13:52:33.705374 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.705525 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 13:52:33.705682 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.705909 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.705995 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.706254 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.706357 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.706581 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.706668 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.706898 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707075 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707232 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707320 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707551 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707656 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707811 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.707937 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708124 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708260 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708443 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-9-iscsi {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708588 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708762 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.708850 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709070 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709157 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709379 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709464 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-9-iscsi {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709786 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.709975 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710065 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710143 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710323 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710430 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710627 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710722 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.710972 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.711643 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712100 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712249 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712363 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712469 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712586 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.712706 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713043 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713185 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713289 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713416 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713499 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713603 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713813 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.713921 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714127 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714235 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714463 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714558 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714784 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.714879 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715093 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715238 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-9-iscsi {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715416 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715554 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715724 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.715867 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716120 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-9-iscsi {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716251 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716443 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716573 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716754 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.716884 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717065 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717190 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717483 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717653 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717791 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.717899 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718101 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718220 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718446 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718563 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718759 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.718854 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719073 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719165 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719377 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719490 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719677 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719763 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.719986 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720073 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720296 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720395 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720591 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720695 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720899 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.720986 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721201 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721345 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721438 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721519 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721743 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.721845 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722059 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722157 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722357 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722443 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722763 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.722946 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723033 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723201 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723310 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723519 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723621 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723833 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.723918 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724084 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724179 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724400 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724495 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724717 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.724818 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725022 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725126 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725322 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725410 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725623 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725723 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.725925 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.726023 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.726244 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.726336 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.726554 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.726669 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.727453 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.727908 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728036 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728236 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728340 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728432 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728511 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728599 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728750 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.728861 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729056 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729143 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729361 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729460 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729699 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729794 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.729996 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730080 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730434 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730644 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730730 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.730962 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731056 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731265 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731371 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731569 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731656 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731873 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.731959 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732178 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732264 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732482 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732567 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732785 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.732869 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733035 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733128 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733339 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733424 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733642 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733727 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.733932 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734020 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734255 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734347 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734563 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734867 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.734954 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.735165 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.735251 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.735710 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.735810 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736021 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736113 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736324 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736409 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736628 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736746 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.736928 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737021 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737226 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737312 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737529 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737622 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737830 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.737916 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738129 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738246 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738461 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738565 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738767 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.738895 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739070 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739165 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739373 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739468 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739675 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739762 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.739978 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740063 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740282 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740376 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740582 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.740969 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741198 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741291 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741500 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741592 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741800 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.741892 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742115 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742237 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742467 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742560 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742779 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.742968 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743086 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743174 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743389 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743475 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743694 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.743779 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744007 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744309 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744396 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744611 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744703 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.744909 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745001 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745212 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745300 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745516 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745609 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745817 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.745915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746117 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746232 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746442 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746528 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746742 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.746831 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747042 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747128 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747346 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747441 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747648 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747735 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.747957 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748177 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748272 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748367 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748560 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748649 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748864 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.748965 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.749170 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.749276 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.749488 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 13:52:33.749576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.749826 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.749924 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750228 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750345 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750510 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750596 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750828 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.750913 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751139 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751231 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751455 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751540 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751780 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.751865 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752092 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752187 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752399 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752491 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752713 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.752806 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753024 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753109 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753338 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753744 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.753972 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754084 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754307 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754398 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754629 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754726 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.754940 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755028 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755262 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755346 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755577 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755681 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.755903 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756008 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756237 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756336 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756565 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756661 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756895 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.756993 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757205 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757291 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757532 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757636 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757852 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.757986 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.758242 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.758454 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.758627 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.758739 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.758902 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759100 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759215 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759426 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759530 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759760 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.759847 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760074 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760161 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760496 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760705 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.760791 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761017 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761112 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761327 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761421 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761637 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761722 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.761946 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762032 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762284 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762391 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762602 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762688 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762913 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.762997 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763224 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763319 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763547 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763632 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763857 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.763943 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764166 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764251 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764474 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764559 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764776 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.764860 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765082 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765188 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765380 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765514 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765684 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765779 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.765983 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766076 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766325 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766628 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766714 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.766944 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767064 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767268 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767367 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767571 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767679 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767880 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.767977 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768190 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768287 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768494 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768603 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768793 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.768888 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769100 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769211 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769404 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769511 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769707 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.769804 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770013 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770098 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770341 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770447 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770644 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770732 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.770958 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771043 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771260 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771346 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771564 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771871 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.771959 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772173 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772262 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772481 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772566 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772788 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.772875 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.773095 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.773189 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.773402 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.773495 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.774405 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.774514 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.774812 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.774907 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775128 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775215 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775442 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775600 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775761 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.775847 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776086 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776190 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776388 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776487 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776710 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.776797 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777014 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777159 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777322 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777418 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777625 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777712 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.777929 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778024 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778249 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778355 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778557 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778657 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778856 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.778953 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779177 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779316 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779461 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779550 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779758 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.779842 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780058 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780144 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780361 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780446 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780662 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780751 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.780962 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781049 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781263 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781562 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781656 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781863 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.781950 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782163 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782279 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782533 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782637 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782841 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.782929 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783164 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783267 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783484 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783581 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783794 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.783888 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784113 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784201 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784423 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784630 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784747 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.784833 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785030 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785125 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785339 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785436 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785735 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.785956 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786042 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786294 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786388 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786610 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786708 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.786930 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787015 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787235 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787323 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787554 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787648 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787855 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.787940 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788169 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788257 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788472 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788559 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788789 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.788885 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.789127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.789319 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790115 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790306 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790464 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790654 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790801 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.790975 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791109 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791288 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791421 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791602 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791742 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.791915 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792049 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792228 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792360 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792549 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792683 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792859 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.792997 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793176 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793320 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793486 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793619 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793796 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.793928 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794107 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794275 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794443 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794587 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794744 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.794875 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795051 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795191 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795363 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795503 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795692 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.795828 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796003 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796100 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796313 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796400 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796627 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796711 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.796934 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797029 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797241 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797328 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797548 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797633 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797851 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.797950 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798154 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798285 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798485 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798572 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798795 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.798881 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799103 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799189 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799410 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799495 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799709 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.799796 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800012 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800167 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800311 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800447 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800591 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800727 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.800892 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801025 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801185 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801322 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801494 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801627 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801799 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.801931 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802112 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802267 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802455 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802599 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802759 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.802891 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803061 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803212 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803350 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803483 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803669 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803801 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.803970 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804116 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804278 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804573 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804664 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.804982 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805084 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805338 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805456 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805649 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805764 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.805956 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806081 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806295 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806429 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806625 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806736 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.806937 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807033 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807251 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807359 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807562 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807661 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807870 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.807956 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808190 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808275 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808504 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808590 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808841 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.808933 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809128 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809248 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809438 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809563 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809749 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.809875 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810068 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810175 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810401 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810518 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810708 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.810828 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811016 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811141 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811316 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811452 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811623 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811756 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.811981 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.812082 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.812369 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.812514 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.812841 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.812925 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813155 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813472 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813568 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813791 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.813877 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814109 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814212 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814463 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814553 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814789 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.814884 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815122 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815206 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815428 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815525 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815737 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.815836 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816041 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816126 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816343 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816427 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816649 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816744 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.816950 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817044 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817249 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817344 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817563 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817648 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817851 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.817946 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818148 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818252 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818476 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818571 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818776 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.818860 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819115 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819241 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819379 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819504 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819678 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819761 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.819979 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820071 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820279 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820364 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820622 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820765 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.820928 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821103 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821237 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821325 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821518 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821612 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821819 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.821913 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822161 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822268 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822487 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822575 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822824 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.822921 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823153 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823239 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823484 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823581 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823787 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.823880 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824092 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824178 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824401 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824486 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824707 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.824798 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825010 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825094 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825308 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825391 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825606 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825699 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825909 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.825993 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.826236 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.826334 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.826540 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.826661 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.826901 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827164 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827256 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827351 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827469 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827741 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.827847 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828130 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828348 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828442 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828656 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828740 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.828963 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829108 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829278 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829409 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829588 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829716 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.829900 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830056 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830223 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830313 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830530 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830652 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830841 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.830939 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.831140 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.831249 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.833972 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834381 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834493 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834599 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834705 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834809 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834913 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.834913 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835127 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835233 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835338 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835441 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835545 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835665 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835772 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.835876 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.836524 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.836703 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.836894 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837132 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837270 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837416 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837533 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837624 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837720 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837833 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.837957 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838167 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838398 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838398 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838622 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838706 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838783 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838859 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838859 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.838999 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839086 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839165 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839239 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839368 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839451 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839600 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839681 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839758 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839833 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839909 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.839985 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840070 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840197 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840284 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840362 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840445 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840523 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840612 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840695 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840862 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.840959 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841170 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841255 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841474 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841561 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841777 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.841874 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842079 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842165 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842406 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842494 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842751 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.842835 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843054 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843147 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843395 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843487 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843704 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.843788 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844018 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844116 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844331 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844416 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844643 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844727 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.844954 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845046 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845258 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845343 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845558 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845641 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845865 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.845961 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846173 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846308 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846500 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846583 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846803 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.846890 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847103 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847235 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847417 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847508 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847725 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.847810 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848034 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848126 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848350 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848452 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848753 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.848966 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849051 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849272 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849359 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849577 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849662 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849882 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.849975 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850186 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850308 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850515 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850630 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850824 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.850953 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.851139 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.851405 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.851510 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.851829 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.852412 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.852634 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.852747 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854220 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854346 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854435 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854519 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854601 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854680 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854780 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854862 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.854948 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855026 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855026 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855026 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855259 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855384 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855729 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855814 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.855975 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856073 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856275 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856369 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856606 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856700 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.856924 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857029 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857251 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857406 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857565 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857654 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.857886 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858008 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858211 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858348 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858545 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858659 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858858 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.858970 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.859158 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.859285 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.859587 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.859746 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.859883 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.860013 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.860193 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.860324 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.860756 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.860861 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861059 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861173 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861359 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861487 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861666 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861799 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.861985 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862111 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862444 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862614 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862793 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.862914 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863048 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863233 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863374 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863536 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863679 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.863984 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864272 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864356 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864583 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864669 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864887 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.864971 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865204 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865296 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865596 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865681 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865905 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.865991 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866224 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866324 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866557 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866641 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866877 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.866961 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.867182 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.867281 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.867572 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.867658 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.867882 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868040 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868204 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868370 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868526 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868679 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868836 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.868994 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.869151 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.869307 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.869465 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.869650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.869789 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870006 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870101 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870325 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870444 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870646 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870765 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.870952 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871176 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871263 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871498 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871585 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871807 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.871891 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872128 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872212 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872452 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872595 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872756 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.872918 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873058 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873228 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873368 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873552 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873674 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873878 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.873964 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874183 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874312 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874512 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874598 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874823 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.874907 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875129 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875215 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875435 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875522 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875760 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.875846 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876064 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876157 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876376 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876463 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876678 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876761 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.876984 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877076 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877294 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877379 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877598 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877690 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.877916 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878001 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878280 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878380 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878561 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878688 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878866 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.878958 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879167 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879252 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879596 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879777 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.879886 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880095 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880181 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880403 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880500 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880709 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880807 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.880996 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881091 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881299 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881395 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881635 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881723 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.881937 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882029 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882281 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882384 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882607 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882694 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.882947 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883038 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883271 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883439 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883572 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883776 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.883861 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884105 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884201 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884422 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884507 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884742 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.884827 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885040 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885134 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885347 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885432 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885647 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885734 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.885947 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886041 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886274 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886367 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886581 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886677 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886886 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.886974 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887191 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887275 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887498 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887594 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887799 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.887895 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888098 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888194 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888399 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888486 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888705 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.888800 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889025 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889110 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889334 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889429 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889637 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889723 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.889940 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890034 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890261 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890363 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890603 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890687 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890906 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.890999 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891231 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891326 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891546 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891634 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891856 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.891941 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892170 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892270 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892475 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892567 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892786 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.892869 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893099 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893185 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893406 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893491 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893717 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.893808 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894029 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894117 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894375 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894466 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894689 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.894941 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895038 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895276 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895370 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895596 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895682 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.895907 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896005 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896221 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896305 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896539 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896773 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.896857 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897101 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897188 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897422 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897507 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897735 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.897834 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.898047 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.898132 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.898396 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.898485 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.899225 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.899338 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.899535 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.899688 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.899844 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900032 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900139 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900351 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900439 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900669 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900756 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.900985 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901084 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901302 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901387 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901662 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901769 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.901978 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902066 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902313 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902406 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902627 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902711 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.902942 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903030 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903253 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903337 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903567 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903652 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903883 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.903979 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904192 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904277 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904503 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904600 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904813 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.904897 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905122 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905206 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905430 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905522 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905741 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.905825 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906050 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906141 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906389 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906486 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906702 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.906791 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907019 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907104 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907333 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907420 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907649 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907744 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.907983 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908164 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908301 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908479 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908617 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908812 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.908931 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.909137 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.909280 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.909460 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.909775 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.909858 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910150 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910273 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910502 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910599 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910808 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.910901 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911114 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911213 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911423 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911510 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911734 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.911836 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912034 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912129 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912347 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912431 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912653 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912738 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.912953 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913050 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913261 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913347 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913564 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913649 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.913885 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.914097 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.914278 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915027 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915125 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915347 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915447 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915676 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.915795 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916001 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916208 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916316 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916559 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916647 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916874 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.916960 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917197 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917284 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917514 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917602 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917828 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.917939 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918137 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918278 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918465 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918553 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918768 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.918856 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919070 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919164 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919381 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919474 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919685 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919781 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.919984 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920080 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920285 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920371 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920593 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920679 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.920902 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921014 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921205 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921296 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921506 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921602 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921806 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.921904 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922104 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922189 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922432 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922519 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922737 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.922825 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923038 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923123 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923345 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923430 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923645 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923732 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.923943 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924028 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924247 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924340 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924547 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924645 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924846 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.924936 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925244 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925452 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925539 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925755 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.925843 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926064 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926159 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926391 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926478 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926698 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.926783 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927002 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927105 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927322 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927409 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927630 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927717 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.927939 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928035 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928250 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928346 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928557 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928651 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.928878 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929102 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929190 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929439 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929555 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929774 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.929955 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.930127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.930328 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.930627 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.930762 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.930896 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931037 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931330 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931424 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931493 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931634 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931720 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.931941 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932028 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932254 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932357 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932558 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932655 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932863 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.932957 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.933170 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.933296 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.933479 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.933578 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.933789 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934127 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934378 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934474 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934572 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934708 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.934803 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.935013 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.935098 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.935319 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.935406 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936102 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936309 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936405 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936497 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936589 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936670 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936749 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936826 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936904 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.936980 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937105 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937194 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937454 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937539 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937769 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.937871 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938073 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938160 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938411 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938500 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938721 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.938820 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939025 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939112 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939336 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939436 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939636 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939731 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.939932 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940036 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940241 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940336 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940566 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940664 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.940962 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941177 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941263 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941532 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941628 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.941956 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942165 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942314 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942504 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942594 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942814 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.942901 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943129 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943214 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943459 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943597 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943769 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.943858 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944088 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944188 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944394 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944481 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944698 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944785 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.944999 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.945094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.945305 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.945876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946172 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946314 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946587 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946701 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946794 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.946875 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947183 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947401 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947489 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947724 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.947812 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948029 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948115 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948328 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948627 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948722 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.948932 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949018 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949229 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949323 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949527 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949621 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949826 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.949911 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950123 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950231 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950448 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950536 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950747 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.950842 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951051 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951146 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951351 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951436 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951649 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951747 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.951945 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952031 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952245 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952343 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952542 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952637 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952841 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.952926 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953143 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953231 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953491 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953659 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953743 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.953828 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954030 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954116 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954382 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954472 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954713 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.954800 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955022 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955108 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955337 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955431 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955641 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955726 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.955947 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956032 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956250 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956337 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956566 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956652 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956872 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.956957 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957182 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957271 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957486 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957585 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957792 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.957888 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958099 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958192 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958440 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958579 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958751 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.958851 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959052 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959138 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959358 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959451 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959665 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959761 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.959981 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960066 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960296 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960382 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960596 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960681 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.960915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.961069 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.961923 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.962129 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.962551 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.962899 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963023 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963221 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963527 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963626 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963836 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.963923 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964166 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964252 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964476 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964571 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964787 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.964884 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965102 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965189 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965424 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965554 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965748 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.965839 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966073 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966159 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966426 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966536 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966753 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.966840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967078 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967163 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967398 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967492 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967741 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.967840 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968100 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968200 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968372 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968459 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968679 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968773 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.968922 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:52:33.969009 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 13:52:33.969208 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 13:52:33.992375 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_db.sqlalchemy.engines [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:33.993878 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_db.sqlalchemy.engines [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.055968 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.context [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5d8c375-2664-443d-97a4-224f3fe0d670(cell1) {{(pid=102647) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:52:34.057579 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.context [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5d8c375-2664-443d-97a4-224f3fe0d670(cell1) {{(pid=102648) load_cells /opt/stack/nova/nova/context.py:464}} May 10 13:52:34.060327 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_concurrency.lockutils [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:52:34.061877 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:52:34.061988 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_concurrency.lockutils [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:52:34.062733 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_concurrency.lockutils [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:52:34.063477 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:52:34.064266 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:52:34.064662 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_concurrency.lockutils [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:52:34.066183 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:52:34.079092 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_db.sqlalchemy.engines [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.080340 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_db.sqlalchemy.engines [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.083000 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_db.sqlalchemy.engines [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.085964 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_db.sqlalchemy.engines [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.242048 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG oslo_db.sqlalchemy.engines [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.247426 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_db.sqlalchemy.engines [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 13:52:34.585502 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: WARNING keystonemiddleware.auth_token [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:52:34.588148 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: WARNING keystonemiddleware.auth_token [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:52:34.592992 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: WARNING keystonemiddleware.auth_token [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:52:34.596439 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: WARNING keystonemiddleware.auth_token [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:52:34.939311 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: WARNING keystonemiddleware.auth_token [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:52:34.942360 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: WARNING keystonemiddleware.auth_token [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 13:52:34.945631 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: WARNING keystonemiddleware.auth_token [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:52:34.949723 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: WARNING keystonemiddleware.auth_token [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 13:52:34.951836 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1bac409c0 pid: 102647 (default app) May 10 13:52:34.953936 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:52:34.954861 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1bac409c0 pid: 102648 (default app) May 10 13:52:34.955151 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-b41ab04a-4701-4462-92f3-9373b01e9fd1 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001797 May 10 13:52:34.955555 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Tue May 10 13:52:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:54.719773 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:54.721099 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 May 10 13:53:54.721874 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:55.175920 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-7c00310e-df96-4ea4-88b5-b5b3d652e6c8 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:55.205366 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-7c00310e-df96-4ea4-88b5-b5b3d652e6c8 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475639 May 10 13:53:55.214260 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1291 bytes} [Tue May 10 13:53:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:53:57.536083 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:53:57.537268 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-dc1bf500-db7e-4574-911f-c59d12567355 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 May 10 13:53:57.539008 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:53:57.599087 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-58b56416-4a9f-4966-b2f4-efbac2ed4110 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "vcpus": 1, "ram": 256, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:57.618475 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:53:57.618475 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: warnings.warn(msg) May 10 13:53:57.646214 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-58b56416-4a9f-4966-b2f4-efbac2ed4110 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100536 May 10 13:53:57.649047 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:53:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:53:57.870108 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-98351c20-67d8-413d-85cf-cc748088a411 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:53:57.872478 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:53:57.872478 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:53:57.922830 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-98351c20-67d8-413d-85cf-cc748088a411 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.266980 May 10 13:53:57.928162 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1335 bytes} [Tue May 10 13:53:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:00.208930 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-58b56416-4a9f-4966-b2f4-efbac2ed4110 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:00.210147 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-58b56416-4a9f-4966-b2f4-efbac2ed4110 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 10 13:54:00.210448 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:00.343610 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-c14fc2d4-0a43-4d04-8158-8be998964dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "disk": 5}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:00.363187 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:54:00.363187 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:54:00.381512 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-c14fc2d4-0a43-4d04-8158-8be998964dcc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164859 May 10 13:54:00.382278 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:00.393779 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0f467a7c-9253-4f08-8796-275d1710c3a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:00.395221 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:54:00.395221 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: warnings.warn(msg) May 10 13:54:00.428453 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-0f467a7c-9253-4f08-8796-275d1710c3a0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038222 May 10 13:54:00.429222 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1335 bytes} [Tue May 10 13:54:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:02.718830 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-c14fc2d4-0a43-4d04-8158-8be998964dcc admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:02.720033 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-c14fc2d4-0a43-4d04-8158-8be998964dcc admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 May 10 13:54:02.720708 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:02.784918 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-8860b483-d7ac-4ab0-8936-4e6488b80dde admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:02.805327 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-8860b483-d7ac-4ab0-8936-4e6488b80dde admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078025 May 10 13:54:02.812804 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:02.818040 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-5d2f8461-3a0e-46ff-b0cf-a354606f5a6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:02.846568 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-5d2f8461-3a0e-46ff-b0cf-a354606f5a6f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032164 May 10 13:54:02.861810 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1335 bytes} [Tue May 10 13:54:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 13:54:05.155928 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-8860b483-d7ac-4ab0-8936-4e6488b80dde admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:05.156969 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-8860b483-d7ac-4ab0-8936-4e6488b80dde admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 10 13:54:05.157425 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:05.219783 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-106eb085-f157-473c-b9e0-93257177a8b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "disk": 10}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:05.239371 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-106eb085-f157-473c-b9e0-93257177a8b5 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075251 May 10 13:54:05.239947 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:05.253131 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-be798387-33de-4b01-83a3-96cc7f655a06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:05.277502 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-be798387-33de-4b01-83a3-96cc7f655a06 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028428 May 10 13:54:05.278149 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1335 bytes} [Tue May 10 13:54:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:07.578884 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-106eb085-f157-473c-b9e0-93257177a8b5 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:07.579890 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-106eb085-f157-473c-b9e0-93257177a8b5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 10 13:54:07.580286 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:07.644073 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:07.664104 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076959 May 10 13:54:07.671595 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:07.676736 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-5eb6fe9f-8672-4253-a284-d017ad789224 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:07.700535 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-5eb6fe9f-8672-4253-a284-d017ad789224 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027588 May 10 13:54:07.701223 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1335 bytes} [Tue May 10 13:54:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:10.036157 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:10.037952 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 May 10 13:54:10.038594 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:10.104569 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-09b3dba8-d75c-4300-969e-fd5ca7fbfdb5 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:10.131481 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-09b3dba8-d75c-4300-969e-fd5ca7fbfdb5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086703 May 10 13:54:10.132028 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1291 bytes} [Tue May 10 13:54:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:12.641925 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:12.643061 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-9812d972-9848-4559-abdb-07ace7b96076 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 May 10 13:54:12.643469 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:12.708056 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-e2b8923b-994d-47b4-9b20-f9dec4f9e3ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "ram": 512}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:12.728667 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-e2b8923b-994d-47b4-9b20-f9dec4f9e3ff admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078641 May 10 13:54:12.729214 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:12.741777 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-3ab4d726-9f0b-421f-aeb8-5cf314975e93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:12.767511 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-3ab4d726-9f0b-421f-aeb8-5cf314975e93 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029836 May 10 13:54:12.768527 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1332 bytes} [Tue May 10 13:54:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 13:54:15.667211 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-e2b8923b-994d-47b4-9b20-f9dec4f9e3ff admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:15.668245 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-e2b8923b-994d-47b4-9b20-f9dec4f9e3ff admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 May 10 13:54:15.668609 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:15.730569 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0c2df593-846d-4dcb-bb81-da1d15dfc128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:15.749983 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-0c2df593-846d-4dcb-bb81-da1d15dfc128 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075380 May 10 13:54:15.750703 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:15.763158 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-84624f91-fbc0-469d-a1b2-c0a4a96d50d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:15.788815 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-84624f91-fbc0-469d-a1b2-c0a4a96d50d4 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029220 May 10 13:54:15.789913 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1332 bytes} [Tue May 10 13:54:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:18.088449 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0c2df593-846d-4dcb-bb81-da1d15dfc128 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:18.089581 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-0c2df593-846d-4dcb-bb81-da1d15dfc128 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 10 13:54:18.090055 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:18.151180 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-e7de7cc1-df02-40d8-97b3-dc80c40b9746 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:18.168605 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-e7de7cc1-df02-40d8-97b3-dc80c40b9746 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072625 May 10 13:54:18.169169 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:18.181459 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-3689175f-63d2-4520-a185-d09f014cb0d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:18.203197 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-3689175f-63d2-4520-a185-d09f014cb0d7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026019 May 10 13:54:18.203772 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1332 bytes} [Tue May 10 13:54:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:20.500569 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-e7de7cc1-df02-40d8-97b3-dc80c40b9746 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:20.501613 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-e7de7cc1-df02-40d8-97b3-dc80c40b9746 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 10 13:54:20.502015 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:20.567302 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-b1dd7be1-ad8a-47be-80a4-7652675dfda3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:20.588323 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-b1dd7be1-ad8a-47be-80a4-7652675dfda3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080257 May 10 13:54:20.588897 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:20.601068 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-c3de4fe3-e88a-4b89-953d-b4c4d852c5d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:20.626490 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-c3de4fe3-e88a-4b89-953d-b4c4d852c5d1 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029643 May 10 13:54:20.639757 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1332 bytes} [Tue May 10 13:54:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:22.978218 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-b1dd7be1-ad8a-47be-80a4-7652675dfda3 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:22.979287 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-b1dd7be1-ad8a-47be-80a4-7652675dfda3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 10 13:54:22.979699 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:23.075475 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:23.101518 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.115776 May 10 13:54:23.102073 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1282 bytes} [Tue May 10 13:54:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:23.123234 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-793c62ca-9e88-4cee-a436-afc9eb30abb9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:23.153164 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-793c62ca-9e88-4cee-a436-afc9eb30abb9 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037663 May 10 13:54:23.153757 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1332 bytes} [Tue May 10 13:54:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:54:47.211450 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:47.212466 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 10 13:54:47.212877 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:54:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:47.272390 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-650e6446-4cfb-4cdf-b88a-6563c2b13af0 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:47.289899 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-650e6446-4cfb-4cdf-b88a-6563c2b13af0 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071121 May 10 13:54:47.290480 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1291 bytes} [Tue May 10 13:54:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:48.341593 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:48.342677 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-39ad7c76-c7e5-4f21-901a-b041bd721a41 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 10 13:54:48.343078 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:48.541897 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0287272c-f205-49ed-9847-1f357dab2514 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:48.547498 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.wsgi [None req-0287272c-f205-49ed-9847-1f357dab2514 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0287272c-f205-49ed-9847-1f357dab2514 admin admin] Request method failure captured: May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept: application/json May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept-Encoding: gzip, deflate May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Connection: keep-alive May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Content-Length: 0 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Host: 10.222.0.32 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-Api-Version: compute 2.90 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-System-Scope: None May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: User-Agent: python-novaclient May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Auth-Token: gAAAAABiem6o1fT0J9xvnUu4oUyjLni3O1vX5VLl7PwgavVVEyHTs7Ydgn1mP1yXV_ZN07_1_mG7PKoXj17QmLC1BCkVBDCyE39iHXC2Y_vQff_E244ejZLNmUcCdMAwdpE04zdVt4k3Gb-hGFKIXBAn_IQNan4UitwWIdzeN7mettACJMOxMGw May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Id: None May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Name: None May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Identity-Status: Confirmed May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Is-Admin-Project: True May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Id: default May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Name: Default May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Name: admin May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Role: admin,reader,member May 10 13:54:48.550883 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Roles: admin,reader,member May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant: admin May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Name: admin May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User: admin May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Id: default May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Name: Default May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Name: admin May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: method: > May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: exception: Flavor 42 could not be found. May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: action_args: {'id': '42'} May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:48.552349 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:48.553915 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:48.555144 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-0287272c-f205-49ed-9847-1f357dab2514 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:48.556165 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-0287272c-f205-49ed-9847-1f357dab2514 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062523 May 10 13:54:48.556165 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1190 bytes} [Tue May 10 13:54:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:48.562676 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ec712cb9-ae9a-456a-97a0-127a7dde7a8a admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:48.593213 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-ec712cb9-ae9a-456a-97a0-127a7dde7a8a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033679 May 10 13:54:48.594224 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:48.619524 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-5699a74b-a68e-43f5-be89-664b36fa0934 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:48.640700 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-5699a74b-a68e-43f5-be89-664b36fa0934 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025562 May 10 13:54:48.641259 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:48.650809 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ec48d837-8c61-44b3-8767-66e35db43579 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:48.656536 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.wsgi [None req-ec48d837-8c61-44b3-8767-66e35db43579 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ec48d837-8c61-44b3-8767-66e35db43579 admin admin] Request method failure captured: May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept: application/json May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept-Encoding: gzip, deflate May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Connection: keep-alive May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Content-Length: 0 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Host: 10.222.0.32 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-Api-Version: compute 2.90 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-System-Scope: None May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: User-Agent: python-novaclient May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Auth-Token: gAAAAABiem6o1fT0J9xvnUu4oUyjLni3O1vX5VLl7PwgavVVEyHTs7Ydgn1mP1yXV_ZN07_1_mG7PKoXj17QmLC1BCkVBDCyE39iHXC2Y_vQff_E244ejZLNmUcCdMAwdpE04zdVt4k3Gb-hGFKIXBAn_IQNan4UitwWIdzeN7mettACJMOxMGw May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Id: None May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Name: None May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Identity-Status: Confirmed May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Is-Admin-Project: True May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Id: default May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Name: Default May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Name: admin May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Role: admin,reader,member May 10 13:54:48.659840 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Roles: admin,reader,member May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant: admin May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Name: admin May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User: admin May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Id: default May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Name: Default May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Name: admin May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: method: > May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: exception: Flavor 42 could not be found. May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: action_args: {'id': '42'} May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:48.661310 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:48.662853 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:48.664362 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ec48d837-8c61-44b3-8767-66e35db43579 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:48.665346 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-ec48d837-8c61-44b3-8767-66e35db43579 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014042 May 10 13:54:48.665346 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1190 bytes} [Tue May 10 13:54:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:49.586038 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-5699a74b-a68e-43f5-be89-664b36fa0934 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:49.587100 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-5699a74b-a68e-43f5-be89-664b36fa0934 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 10 13:54:49.587497 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:49.776026 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-a9d4c950-4565-45c3-9ab0-0095830e82a6 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:49.781377 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.wsgi [None req-a9d4c950-4565-45c3-9ab0-0095830e82a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-a9d4c950-4565-45c3-9ab0-0095830e82a6 admin admin] Request method failure captured: May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept: application/json May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept-Encoding: gzip, deflate May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Connection: keep-alive May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Content-Length: 0 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Host: 10.222.0.32 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-Api-Version: compute 2.90 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-System-Scope: None May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: User-Agent: python-novaclient May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Auth-Token: gAAAAABiem6pN3F7d8d7i-8NYXJGlJ9ErTHl7q-SSuGLHRt08ujZiX93I49zCeaU183yGprZIkvgeaLh7wK82rhFsN8QvcQZC_jhMOsaow9TkLyYDdGUeAPy0Lxrn7GBY6ZT600DgRWEabzmos3byW4CvCPzB1C4Ue5SU5quVv6PO1VLSSFCjPA May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Id: None May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Name: None May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Identity-Status: Confirmed May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Is-Admin-Project: True May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Id: default May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Name: Default May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Name: admin May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Role: admin,reader,member May 10 13:54:49.782927 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Roles: admin,reader,member May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant: admin May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Name: admin May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User: admin May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Id: default May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Name: Default May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Name: admin May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: method: > May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: exception: Flavor 84 could not be found. May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: action_args: {'id': '84'} May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:49.784468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:49.785328 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:49.786393 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-a9d4c950-4565-45c3-9ab0-0095830e82a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:49.788046 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-a9d4c950-4565-45c3-9ab0-0095830e82a6 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061141 May 10 13:54:49.788046 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1190 bytes} [Tue May 10 13:54:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:49.794818 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-edc5fbe6-02d0-473e-9029-984fa61e8142 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:49.809286 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-edc5fbe6-02d0-473e-9029-984fa61e8142 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018056 May 10 13:54:49.809879 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:49.820657 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ffa68477-709b-4c3f-adcc-1a60a5e8ee0f admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:49.834696 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-ffa68477-709b-4c3f-adcc-1a60a5e8ee0f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018405 May 10 13:54:49.835286 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:49.844849 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-08d80e0e-7f24-42df-b4be-4ef91d7daf78 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:49.850350 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.wsgi [None req-08d80e0e-7f24-42df-b4be-4ef91d7daf78 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-08d80e0e-7f24-42df-b4be-4ef91d7daf78 admin admin] Request method failure captured: May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept: application/json May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept-Encoding: gzip, deflate May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Connection: keep-alive May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Content-Length: 0 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Host: 10.222.0.32 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-Api-Version: compute 2.90 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-System-Scope: None May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: User-Agent: python-novaclient May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Auth-Token: gAAAAABiem6pN3F7d8d7i-8NYXJGlJ9ErTHl7q-SSuGLHRt08ujZiX93I49zCeaU183yGprZIkvgeaLh7wK82rhFsN8QvcQZC_jhMOsaow9TkLyYDdGUeAPy0Lxrn7GBY6ZT600DgRWEabzmos3byW4CvCPzB1C4Ue5SU5quVv6PO1VLSSFCjPA May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Id: None May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Name: None May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Identity-Status: Confirmed May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Is-Admin-Project: True May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Id: default May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Name: Default May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Name: admin May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Role: admin,reader,member May 10 13:54:49.851876 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Roles: admin,reader,member May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant: admin May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Name: admin May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User: admin May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Id: default May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Name: Default May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Name: admin May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: method: > May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: exception: Flavor 84 could not be found. May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: action_args: {'id': '84'} May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:49.853666 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:49.854719 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:49.856758 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-08d80e0e-7f24-42df-b4be-4ef91d7daf78 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:49.858594 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-08d80e0e-7f24-42df-b4be-4ef91d7daf78 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012044 May 10 13:54:49.858594 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1190 bytes} [Tue May 10 13:54:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:50.751197 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ffa68477-709b-4c3f-adcc-1a60a5e8ee0f admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:50.752206 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-ffa68477-709b-4c3f-adcc-1a60a5e8ee0f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 13:54:50.752621 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:50.942214 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-cf26e5a4-5913-400d-9d18-fbd41581b976 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:50.949130 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.wsgi [None req-cf26e5a4-5913-400d-9d18-fbd41581b976 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-cf26e5a4-5913-400d-9d18-fbd41581b976 admin admin] Request method failure captured: May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept: application/json May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Accept-Encoding: gzip, deflate May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Connection: keep-alive May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Content-Length: 0 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Host: 10.222.0.32 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-Api-Version: compute 2.90 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Openstack-System-Scope: None May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: User-Agent: python-novaclient May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Auth-Token: gAAAAABiem6qWiRd-Qx0zaTOHBbHFb79EEKpRZnd5UC7KMkDsSEyn1tG9e6KXfK5qFGv-bMstF7e8aYoDK274m506065ctu4e8oOfkeJj9ilIuUIyFvPlHulKLKkerFhXdthBbFU2cenF2iAbhBhp5ngy0Ghojw8mVIBy2EWEU8gIfFMq_WGhkI May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Id: None May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Domain-Name: None May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Identity-Status: Confirmed May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Is-Admin-Project: True May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Id: default May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Domain-Name: Default May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Project-Name: admin May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Role: admin,reader,member May 10 13:54:50.950667 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Roles: admin,reader,member May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant: admin May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-Tenant-Name: admin May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User: admin May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Id: default May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Domain-Name: Default May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: X-User-Name: admin May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: method: > May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: exception: Flavor 451 could not be found. May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: action_args: {'id': '451'} May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:50.952162 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:50.953000 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: ERROR nova.api.openstack.wsgi May 10 13:54:50.954094 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-cf26e5a4-5913-400d-9d18-fbd41581b976 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:50.955154 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-cf26e5a4-5913-400d-9d18-fbd41581b976 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062049 May 10 13:54:50.955154 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:54:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:50.962802 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-903b7206-e61e-4907-b00d-9921a27b6f41 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:50.977146 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-903b7206-e61e-4907-b00d-9921a27b6f41 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018543 May 10 13:54:50.977645 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 13:54:50.987348 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:51.001013 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017494 May 10 13:54:51.001549 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1210 bytes} [Tue May 10 13:54:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:54:51.011262 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-be104ced-a344-45a8-85da-b5a851079c45 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:51.016575 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.wsgi [None req-be104ced-a344-45a8-85da-b5a851079c45 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-be104ced-a344-45a8-85da-b5a851079c45 admin admin] Request method failure captured: May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept: application/json May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Accept-Encoding: gzip, deflate May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Connection: keep-alive May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Content-Length: 0 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Host: 10.222.0.32 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-Api-Version: compute 2.90 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Openstack-System-Scope: None May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: User-Agent: python-novaclient May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Auth-Token: gAAAAABiem6qWiRd-Qx0zaTOHBbHFb79EEKpRZnd5UC7KMkDsSEyn1tG9e6KXfK5qFGv-bMstF7e8aYoDK274m506065ctu4e8oOfkeJj9ilIuUIyFvPlHulKLKkerFhXdthBbFU2cenF2iAbhBhp5ngy0Ghojw8mVIBy2EWEU8gIfFMq_WGhkI May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Id: None May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Domain-Name: None May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Identity-Status: Confirmed May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Is-Admin-Project: True May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Openstack-Nova-Api-Version: 2.90 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Id: default May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Domain-Name: Default May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Project-Name: admin May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Role: admin,reader,member May 10 13:54:51.018044 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Roles: admin,reader,member May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a83c1c4876b14f72a0e3d2113130a776"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a83c1c4876b14f72a0e3d2113130a776", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant: admin May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Id: a83c1c4876b14f72a0e3d2113130a776 May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-Tenant-Name: admin May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User: admin May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Id: default May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Domain-Name: Default May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Id: 2917275ac848431ab364bc258730628d May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: X-User-Name: admin May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: method: > May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: exception: Flavor 451 could not be found. May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: action_args: {'id': '451'} May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 13:54:51.019576 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:51.020589 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: ERROR nova.api.openstack.wsgi May 10 13:54:51.022421 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-be104ced-a344-45a8-85da-b5a851079c45 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 13:54:51.023432 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-be104ced-a344-45a8-85da-b5a851079c45 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011730 May 10 13:54:51.023432 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:54:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 13:54:51.906982 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:51.907997 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 10 13:54:51.908398 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:52.099134 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-5b2a0635-11fd-40b2-bf44-2401cf8f9c7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:52.117698 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-5b2a0635-11fd-40b2-bf44-2401cf8f9c7a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071556 May 10 13:54:52.118184 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1235 bytes} [Tue May 10 13:54:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:53.015026 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:53.016047 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 10 13:54:53.016456 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:53.225590 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-0144818e-d18e-445d-b9ae-d52bed2b1c57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:53.243032 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-0144818e-d18e-445d-b9ae-d52bed2b1c57 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078433 May 10 13:54:53.243581 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1235 bytes} [Tue May 10 13:54:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:54.147237 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:54.148258 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 10 13:54:54.148671 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:54.340273 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-3438f921-be2f-4c0c-a054-71ff29199a29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:54.360284 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-3438f921-be2f-4c0c-a054-71ff29199a29 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071815 May 10 13:54:54.360771 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1235 bytes} [Tue May 10 13:54:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:55.261407 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:55.262452 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 10 13:54:55.262858 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:55.450831 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-7591d84a-6b73-4609-856e-bf1f1faa4554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 13:54:55.467982 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-7591d84a-6b73-4609-856e-bf1f1faa4554 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068500 May 10 13:54:55.468525 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1235 bytes} [Tue May 10 13:54:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:54:56.385396 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:56.386487 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 10 13:54:56.386893 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:54:56.575137 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-fc7189fd-3781-477e-9fea-11c22c860813 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:54:56.595062 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-fc7189fd-3781-477e-9fea-11c22c860813 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071684 May 10 13:54:56.595607 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1202 bytes} [Tue May 10 13:54:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:55:59.901375 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:55:59.902452 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-790a701c-1dd6-43d5-a62e-6e7354f6d249 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 10 13:55:59.902855 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 930 bytes} [Tue May 10 13:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:55:59.960793 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-52ccb0f5-cb89-4390-b1bc-5535c7a8119e admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:55:59.980247 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-52ccb0f5-cb89-4390-b1bc-5535c7a8119e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071429 May 10 13:55:59.980781 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1291 bytes} [Tue May 10 13:55:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 13:56:00.005075 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-d9f5b812-c79f-4b15-9160-f51937d3f56e admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:56:00.012878 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-d9f5b812-c79f-4b15-9160-f51937d3f56e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012684 May 10 13:56:00.013404 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1282 bytes} [Tue May 10 13:55:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:56:00.024468 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-651df8a0-efb6-4f67-b2f5-bf9ec5377558 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:56:00.032032 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-651df8a0-efb6-4f67-b2f5-bf9ec5377558 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011130 May 10 13:56:00.032558 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1285 bytes} [Tue May 10 13:56:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:56:00.044153 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:56:00.052370 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011722 May 10 13:56:00.052936 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1285 bytes} [Tue May 10 13:56:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:56:00.064103 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-0f60f3c0-238f-4fa7-be2a-d53ce1d04c8c admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:56:00.072739 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-0f60f3c0-238f-4fa7-be2a-d53ce1d04c8c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012151 May 10 13:56:00.073308 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1282 bytes} [Tue May 10 13:56:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 13:59:29.696515 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:29.697525 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 10 13:59:29.697924 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 35/69] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:59:29.977337 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:29.978513 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:29.978513 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:59:29.979700 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:29.980143 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:29.980928 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:29.981354 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:30.014707 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-40fd9bf4-1e9f-4569-aa5a-de7c97ab1774 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159739 May 10 13:59:30.015277 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 35/70] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:59:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:59:30.953832 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:30.954895 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 10 13:59:30.955303 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 36/71] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:59:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:59:31.179615 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:31.180784 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:31.180784 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:59:31.181983 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:31.182465 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:31.183263 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:31.183765 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:31.204347 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-e4908903-11b7-4753-a9a5-aeea295fcb6e admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.095482 May 10 13:59:31.204924 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 36/72] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:59:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 13:59:42.563003 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:42.564019 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 10 13:59:42.564420 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 37/73] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 13:59:42.753865 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:42.755085 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:42.755085 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:59:42.756369 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:42.756952 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:42.757751 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:42.758174 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:42.783135 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-ddbf51cd-8538-44b1-97b6-5e88d653ce51 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081839 May 10 13:59:42.783626 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 37/74] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:59:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 13:59:43.695637 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: DEBUG nova.api.openstack.wsgi [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] Calling method '>' {{(pid=102647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:43.696650 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: INFO nova.api.openstack.requestlog [None req-6c92c445-3935-42cc-b837-d577f1da9c7a admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 10 13:59:43.697047 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: [pid: 102647|app: 0|req: 38/75] 10.222.0.32 () {56 vars in 1074 bytes} [Tue May 10 13:59:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 13:59:43.890462 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG nova.api.openstack.wsgi [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] Calling method '>' {{(pid=102648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 13:59:43.891665 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 13:59:43.891665 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: warnings.warn(msg) May 10 13:59:43.892850 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:43.893296 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:43.894087 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 13:59:43.894587 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: DEBUG oslo_concurrency.lockutils [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 13:59:43.918069 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: INFO nova.api.openstack.requestlog [None req-df5220cb-36fe-4bb3-9b76-07f62366f7bf admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081173 May 10 13:59:43.918599 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: [pid: 102648|app: 0|req: 38/76] 10.222.0.32 () {60 vars in 1193 bytes} [Tue May 10 13:59:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:00:42.710445 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: Tue May 10 14:00:42 2022 - graceful shutdown triggered... May 10 14:00:42.710153 dv-cinder-835881-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 14:00:42.711504 dv-cinder-835881-9-iscsi devstack@n-api.service[102647]: Gracefully killing worker 1 (pid: 102647)... May 10 14:00:42.712166 dv-cinder-835881-9-iscsi devstack@n-api.service[102648]: Gracefully killing worker 2 (pid: 102648)... May 10 14:00:43.711173 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: worker 1 buried after 1 seconds May 10 14:00:43.711173 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: worker 2 buried after 1 seconds May 10 14:00:43.711173 dv-cinder-835881-9-iscsi devstack@n-api.service[102646]: goodbye to uWSGI. May 10 14:00:43.712815 dv-cinder-835881-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 14:00:43.713384 dv-cinder-835881-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 14:00:43.716073 dv-cinder-835881-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 14:00:43.729566 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 14:00:43 2022] *** May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: nodename: dv-cinder-835881-9-iscsi May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: machine: x86_64 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: clock source: unix May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: pcre jit disabled May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: detected number of CPU cores: 4 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: current working directory: / May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: detected binary path: /usr/bin/uwsgi-core May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: your processes number limit is 47680 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: your memory page size is 4096 bytes May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: detected max file descriptor number: 2048 May 10 14:00:43.744742 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: lock engine: pthread robust mutexes May 10 14:00:43.745878 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: thunder lock: enabled May 10 14:00:43.745878 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 14:00:43.745878 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 14:00:43.793502 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: Python main interpreter initialized at 0x56216653a9c0 May 10 14:00:43.793502 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: python threads support enabled May 10 14:00:43.793502 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: your server socket listen backlog is limited to 100 connections May 10 14:00:43.793502 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: your mercy for graceful operations on workers is 90 seconds May 10 14:00:43.793959 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: mapped 403077 bytes (393 KB) for 2 cores May 10 14:00:43.793959 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: *** Operational MODE: preforking *** May 10 14:00:43.794223 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: *** uWSGI is running in multiple interpreter mode *** May 10 14:00:43.794223 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: spawned uWSGI master process (pid: 117167) May 10 14:00:43.794449 dv-cinder-835881-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 14:00:43.795069 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: spawned uWSGI worker 1 (pid: 117185, cores: 1) May 10 14:00:43.795428 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: spawned uWSGI worker 2 (pid: 117186, cores: 1) May 10 14:00:43.797601 dv-cinder-835881-9-iscsi devstack@n-api.service[117167]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 14:00:45.034449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:00:45.093928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 14:00:45.850982 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:00:45.850982 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: from cryptography.utils import int_from_bytes May 10 14:00:45.851799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:00:45.851799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: from cryptography.utils import int_from_bytes May 10 14:00:45.888983 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:00:45.888983 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: from cryptography.utils import int_from_bytes May 10 14:00:45.889485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 14:00:45.889485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: from cryptography.utils import int_from_bytes May 10 14:00:48.404911 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:00:48.405820 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:00:48.405820 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:00:48.406187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:00:48.406352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:00:48.406760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.407112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.407605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.407773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.408102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.408421 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.408754 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.409084 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.409422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.409694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.410021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.410390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-9-iscsi {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.410722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.411042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.411366 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.411699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.412245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.413143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.413467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.413992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.415457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.415457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.415457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.415742 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.416058 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.416382 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.416713 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.417040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.417374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.417694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.418117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-9-iscsi {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.418478 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.418808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.419134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.419583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.419891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.420214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.420611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.420885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.421206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.421554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.421876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.422232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.422574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.422889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.423211 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.423531 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.423865 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.424181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.424547 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.424761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.425194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.425500 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.425808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.426146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.426436 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.426696 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.427027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.427363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.429030 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.429312 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.429561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.430040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.430481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.430481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.430995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.431197 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.431411 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.431705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.432046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.432371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.432706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.433124 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.433375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.433700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.434049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.434410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.434729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.435064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.435396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.435723 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.436039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.436358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.436689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.437023 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.437420 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.437587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.437900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.438290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.438565 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.438883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.439203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.439523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.439834 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.440155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.440478 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.440789 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.441106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.441422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.441737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.442125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.442417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.442749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.443850 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.444674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.445029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.445359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.445686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.446014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.446384 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.446711 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.447038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.447380 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.447705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.448023 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.448355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.448686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.449008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.449340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.449652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.449972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.450337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.450660 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.450979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.451297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.452187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.452187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.452488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.452639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.452840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.453153 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.453485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.453818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.454142 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.454490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.454811 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.455143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.455494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.455835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.456189 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.456515 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.456860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.457202 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.457536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.457863 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.458191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.458557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.459116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.459978 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.460311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.460648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.460985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.461331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.461662 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.461994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.462355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.462684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.463016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.463360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.463700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.464020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.464378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.464735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.465061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.465398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.465749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.466184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.466408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.466715 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.467052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.467402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.467726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.468060 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.468384 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.468717 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.469041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.469362 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.469685 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.470031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.470457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.470787 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.471113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.471443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.471766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.472089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.472413 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.472730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.473045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.473416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.473684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.473984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.474463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.475548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.475837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.476162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.476485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.476812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.477140 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.477467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.477786 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.478117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.478486 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.478806 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.479152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.479476 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.479795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.480136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.480456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.480847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.481095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.481422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.481743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.482069 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.482495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.482836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.483163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.483570 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.483842 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.484203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.484701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.484953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.485167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.485498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.485849 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.486192 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.486490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.486858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.487119 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.487440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.487817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.488218 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.488395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.488708 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.489061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.489361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.489644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.490751 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.492172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.492172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.492582 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.492734 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.493031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.493383 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.493862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.494051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.494410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.494840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.495068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.495394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.495721 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.496049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.496381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.496706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.497037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.497358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.497693 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.498015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.498373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.498692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.499023 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.499376 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.499729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.500061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.500397 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.500721 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.501048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.501371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.502293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.502293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.502596 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.502738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.502980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.503479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.503739 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.504865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 14:00:48.505337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.505428 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 14:00:48.505538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.505538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.505743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 14:00:48.506337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.506421 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 14:00:48.506509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.506589 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 14:00:48.506777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.510241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.510476 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.510650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.510814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.510984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.511239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.511239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.511590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.511739 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.511891 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.512046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.512197 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.512360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.512549 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.512696 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.512847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.513006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.513201 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.513367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.513519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.513872 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.514046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835881-9-iscsi {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.514324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.514494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.514667 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.514821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.514965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.515116 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.515270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.515421 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.515573 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.515717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.515860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.516002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.516160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.516313 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.516490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.516490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.516809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.516972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.517129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.517286 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.517437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.517437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.517858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.517858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.518629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.518788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.518946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.519107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.519310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.519310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.519607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.519769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.520016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.520256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.520415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.520596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.520750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.520750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.521089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835881-9-iscsi {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.521487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.521671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.521821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.522005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.522273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.522430 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.522593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.522811 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.522993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.523140 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.523291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.523444 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.523598 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.523761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.523905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.524056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.524217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.524371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.524538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.524690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.524840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.524994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.525138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.525281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.525444 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.525608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.525608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.525900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.525900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.526228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.526228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.526228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.526657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.526808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.526951 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.527103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.527246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.527397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.527397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.527679 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.527847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.528123 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.529203 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.529373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.529520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.529675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.529836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.530009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.530271 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.530271 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.530670 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.530817 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.530971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.531115 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.531266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.531419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.531562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.531704 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.531857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.532002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.532152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.532295 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.532447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.532601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.532601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.532871 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.533013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.533163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.533308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.533459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.533609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.533760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.533904 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.534068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.534236 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.534396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.534550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.534694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.534694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.534998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.534998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.535388 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.535533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.535760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.535916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.536063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.536214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.536365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.536523 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.536666 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.536910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.537063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.537207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.537358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.537501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.537652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.537804 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.537948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.537948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.538410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.538669 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.538819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.538976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.539459 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.539614 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.539768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.539919 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.540077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.540243 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.540498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.540730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.540886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.540886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.541179 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.541333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.541477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.541630 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.541774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.541917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.542074 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.542246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.542415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.542560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.542703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.542856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.542999 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.543152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.543302 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.543446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.543446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.543795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.543948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.544103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.544259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.544404 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.544555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.544712 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.544863 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.545012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.545168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.545313 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.545457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.545610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.545770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.545770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.546057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.546279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.546450 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.546596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.546745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.546895 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.547059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.547210 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.547352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.547501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.547645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.547801 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.547951 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.548093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.548235 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.548235 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.548648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.548892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.549050 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.549224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.549755 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.549910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.550054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.550267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.551568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.551739 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.551909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.552056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.552200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.552888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.553062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.553224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.553404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.553555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.553721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.553874 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.554038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.554210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.554381 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.554381 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.554688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.554839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.554997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.555147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.555303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.555464 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.555623 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.555781 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.555940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.556090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.556240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.556397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.556557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.556708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.556877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.557037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.557188 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.557346 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.557509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.557666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 14:00:48.557816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.557965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.558123 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.558374 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.558529 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.558814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.559088 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.560244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.560411 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.560593 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.560854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.561281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.561440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.561440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.561853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562679 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.562837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.563281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.563440 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.563591 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.563746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.563905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.564846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565643 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565800 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.565961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.566129 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.566461 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.566646 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.566803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.566960 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567296 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567598 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567754 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.567905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.568177 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.568960 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.569227 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.569386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.569530 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.569690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.569969 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.570496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.570665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.570827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571715 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.571884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572134 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.572907 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.573058 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.573212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.573355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.573504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.573654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574632 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.574947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.575321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.575500 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.575653 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.575812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.575971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576859 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.576944 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577528 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577875 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.577959 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578570 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578647 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.578932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579211 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579400 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579740 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.579836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580235 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.580873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581602 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581692 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581858 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.581954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582150 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582501 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582763 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.582845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583004 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583194 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583565 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583721 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583812 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.583903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584007 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584007 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584166 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584252 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584736 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.584911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585186 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585283 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585283 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585436 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585602 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.585964 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586306 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586899 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.586989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587479 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587835 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.587926 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588183 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588616 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588790 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588875 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.588964 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589137 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589405 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589635 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.589994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.590920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.591844 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592058 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592370 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592683 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.592860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593104 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593755 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.593984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594417 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594736 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.594955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.595045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.595908 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596476 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.596947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597176 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.597888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.598109 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.598338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.598421 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.598530 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.598733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600171 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.600923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601099 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601183 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601537 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601698 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.601879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.602015 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.602220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.602341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.602659 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.602995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.603315 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.603472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.603684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.603843 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.603970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604202 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.604958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605307 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.605925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.606940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607174 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.607923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.608898 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609108 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609209 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609749 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.609839 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610064 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610512 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610750 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.610848 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.611972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612302 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.612954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613693 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.613916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.614010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.614266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.614533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.614627 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.615633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.615747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.615957 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.616281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.616493 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.616592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.616832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.616932 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617850 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.617942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.618934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619231 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619560 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619759 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.619850 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620159 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620732 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.620982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.621101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.621281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.621379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.621580 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.621672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622470 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622692 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.622948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623269 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623584 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.623926 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.624905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625012 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625216 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625307 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.625891 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626086 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.626898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627236 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627459 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.627864 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628480 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.628992 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629307 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629710 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.629930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.630020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.630260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.630369 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.631360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.631538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.631647 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.631842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.632160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.632247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.632470 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.632571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.632775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633036 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633140 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.633989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634090 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634733 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.634942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.635040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.635246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.636343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.636574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.636674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.636776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.636979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637072 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637298 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637712 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.637946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.638048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.638268 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.638467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.638737 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.638853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.639218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.639338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.640074 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.640074 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.640343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.640566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.640869 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.641252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.642961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.643589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.643660 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.644192 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.644516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.644516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.645241 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.645241 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.645586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.645987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.646299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.647274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.647618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.647807 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.647947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.648214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.648318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.648559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.648656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.648907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649679 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.649915 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650893 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.650996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.651245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.651558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.651682 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.651897 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652221 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.652885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653406 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.653862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654186 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654522 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.654847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655168 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655744 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.655869 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656063 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.656805 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657450 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.657776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658014 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658444 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.658939 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659577 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659680 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.659978 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.660250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.660803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.660903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661000 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661268 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661442 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.661677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.662357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.662462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.662795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.663939 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664022 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.664994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665786 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.665956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.666101 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.666354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.666478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.666678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.666781 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667118 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.667960 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.668931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.669987 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670336 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.670965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.671911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.672087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.672226 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.672405 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.672531 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.672719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673135 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673357 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673669 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.673986 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674190 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674514 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674614 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.674918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.675858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676164 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.676788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.677010 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.677112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.677404 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.678121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.678436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.678745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.678856 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679556 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679778 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.679884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680101 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680202 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680755 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.680846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681060 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681147 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681374 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681472 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.681813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682036 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682385 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.682790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683655 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683758 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.683981 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684397 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684713 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.684956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685057 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685283 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685718 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.685935 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686031 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.686911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687043 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.687940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688469 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.688947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689109 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689261 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689423 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689715 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.689873 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690031 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690601 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.690918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.691062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.691201 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117185) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:00:48.691341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.691556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.691880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.692186 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.692512 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.692824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.693132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.693437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.693747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.694113 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.694416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.694746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.695082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.695415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.695729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.696067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.696398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.696717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.697036 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.697398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.697705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.698009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.698341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.698652 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.698958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.699265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.699579 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.699886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.700191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.700501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.700824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.701129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.701452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.701763 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.702070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.702398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.702705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.703051 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.703358 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.703712 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.704014 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.704338 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.704670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.704982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.705308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.705626 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.705945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.706288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.706608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.706927 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.707247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.707564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.707877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.708196 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.708517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.708966 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.709457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.709723 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.710040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.710383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.710705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.711021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.711334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.711838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.712250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.712860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.713132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.713235 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.713530 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.713865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.714230 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.714551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.714867 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.715186 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.715504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.715863 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.716182 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.716286 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_db.sqlalchemy.engines [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.716492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.716816 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.717133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.717446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.717760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.718073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.718412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.718728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.719042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.719356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.719673 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.719993 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.720320 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.720660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.720989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.721903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.722255 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.722584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.723150 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.723473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.723814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.724143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.725086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.726008 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.726008 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.726254 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.726478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.726788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.727108 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.727422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.727729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.728056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.728372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.728687 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.729010 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.729323 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.729861 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.730227 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.730554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.730880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.731207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.731528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.731834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.732161 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.732492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.732775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.733093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.733405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.733711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.734017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.734356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.734674 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.734976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.735287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.735590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.735919 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.736223 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.736528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.736832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.737145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.737447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.737750 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.738055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.738384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.738697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.739002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.739313 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.739617 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.740911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.740911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.741590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.741725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.742000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.742332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.742642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.742963 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.743279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.743607 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.743923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.744240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.744588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.744907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.745460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.745800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.746123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.746499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.746833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.747143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.747453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.747762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.748088 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.748404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.748717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.749030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.749343 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.749728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.750051 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.750387 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.750707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.751025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.751334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.751645 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.751959 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.752276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.752622 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.753357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.753357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.753650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.753865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.754288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.754510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.754822 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.755134 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.756584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.756584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.756584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.756584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.757154 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.757297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.757569 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.757893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.758308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.758551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.758876 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.759192 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.759516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.759830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.760162 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.760503 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.760840 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.761167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.761472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.761778 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.762085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.762420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.762742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.763055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.763360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.763664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.763976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.764281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.764586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.764888 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.765191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.765500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.765801 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.766103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.766430 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.766734 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.767037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.767341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.767655 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.767961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.768262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.768565 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.768870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.769173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.769504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.769839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.770157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.770503 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.770821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.771181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.772143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.772487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.772845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.773152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.773472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.773815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.774129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.774624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.774792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.775111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.775427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.775743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.776076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.776410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.776722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.777050 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.777367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.777848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.778045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.778333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.778665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.778983 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.779312 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.779620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.779934 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.780248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.780568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.780888 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.781218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.781556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.781881 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.782247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.782510 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.context [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5d8c375-2664-443d-97a4-224f3fe0d670(cell1) {{(pid=117185) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:00:48.782608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.782883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.783231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.783563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.783878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.784192 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.784496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 14:00:48.784741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 14:00:48.787703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.789219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.790041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.792009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.804559 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_db.sqlalchemy.engines [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.805299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_db.sqlalchemy.engines [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.809510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_db.sqlalchemy.engines [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.875678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.context [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e5d8c375-2664-443d-97a4-224f3fe0d670(cell1) {{(pid=117186) load_cells /opt/stack/nova/nova/context.py:464}} May 10 14:00:48.880103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.882403 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.883221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:00:48.885170 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:00:48.897292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_db.sqlalchemy.engines [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.898179 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_db.sqlalchemy.engines [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:48.968170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_db.sqlalchemy.engines [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117185) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:49.065200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_db.sqlalchemy.engines [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 14:00:49.292654 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: WARNING keystonemiddleware.auth_token [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:00:49.300306 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: WARNING keystonemiddleware.auth_token [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:00:49.406401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: WARNING keystonemiddleware.auth_token [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:00:49.416793 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: WARNING keystonemiddleware.auth_token [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:00:49.659577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: WARNING keystonemiddleware.auth_token [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:00:49.666547 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: WARNING keystonemiddleware.auth_token [None req-e6d69b56-caf9-4392-9f35-46c7b411898f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:00:49.671983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56216653a9c0 pid: 117185 (default app) May 10 14:00:49.778903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: WARNING keystonemiddleware.auth_token [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 14:00:49.785238 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: WARNING keystonemiddleware.auth_token [None req-553b0e54-4d1d-4f4e-9b97-a2e3c8def9b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 14:00:49.791965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56216653a9c0 pid: 117186 (default app) May 10 14:01:30.808535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a342e002-6979-438c-9a11-a1fbd1999661 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Action: 'create', calling method: .version_select at 0x7efd582c0280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-193034320", "metadata": {"Type": "work"}}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:32.421675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a342e002-6979-438c-9a11-a1fbd1999661 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.372980 May 10 14:01:32.423563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1155 bytes} [Tue May 10 14:01:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2375 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:01:32.851671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-167797fe-5f8a-4efc-8def-8df06b94e66c tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Calling method '.version_select at 0x7efd583030d0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:33.465412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-26d7c431-5f1d-4e4c-b377-12b5fa711199 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Action: 'create', calling method: .version_select at 0x7efd581191f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1855913305"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:34.094698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-26d7c431-5f1d-4e4c-b377-12b5fa711199 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.055220 May 10 14:01:34.095521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 2/2] 10.222.0.32 () {60 vars in 1154 bytes} [Tue May 10 14:01:33 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1057 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 14:01:34.108677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cfbac64f-4dd4-4758-a5e2-e79381bfe9d2 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd58119820>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:34.186679 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cfbac64f-4dd4-4758-a5e2-e79381bfe9d2 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 200 len: 345 microversion: 2.1 time: 0.081960 May 10 14:01:34.187702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 3/3] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:34 2022] GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:34.678834 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1096991957", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "networks": [{"uuid": "63e3b9a3-6735-4ab6-ace1-2a506015af5f"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:34.680419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-167797fe-5f8a-4efc-8def-8df06b94e66c tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5" status: 200 len: 353 microversion: 2.1 time: 2.249096 May 10 14:01:34.681306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 1/4] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:32 2022] GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5 => generated 353 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:34.686871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e275da5a-9ddb-49cf-a48c-a54ff46965de tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd58138280>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:34.821906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e275da5a-9ddb-49cf-a48c-a54ff46965de tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/1be7b763-e4b8-45c6-bc18-947357633be8" status: 200 len: 350 microversion: 2.1 time: 0.139176 May 10 14:01:34.830042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 2/5] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:34 2022] GET /compute/v2.1/os-volumes/1be7b763-e4b8-45c6-bc18-947357633be8 => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:34.843245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4bc606e7-db10-41b3-8bf4-7bca37ac5bb5 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Calling method '.version_select at 0x7efd581389d0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:34.884348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] validate_networks() for [('63e3b9a3-6735-4ab6-ace1-2a506015af5f', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:01:35.400802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4bc606e7-db10-41b3-8bf4-7bca37ac5bb5 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5" status: 200 len: 353 microversion: 2.1 time: 0.562986 May 10 14:01:35.401770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 3/6] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:34 2022] GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5 => generated 353 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:35.407833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3a216fb8-3e4b-4a19-9ffb-a553cec53259 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd58138c10>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:35.700453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3a216fb8-3e4b-4a19-9ffb-a553cec53259 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 200 len: 346 microversion: 2.1 time: 0.297224 May 10 14:01:35.702059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:35 2022] GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:35.724839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3d4ebe9d-892a-4b24-b944-5c94e92f4ee0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Calling method '.version_select at 0x7efd581384c0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:35.909836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3d4ebe9d-892a-4b24-b944-5c94e92f4ee0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5" status: 202 len: 0 microversion: 2.1 time: 0.189045 May 10 14:01:35.910524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:01:35 2022] DELETE /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:01:35.917305 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8acec535-6c8d-46ea-a4d2-2f6da27215cc tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Action: 'create', calling method: .version_select at 0x7efd581400d0>, body: {"snapshot": {"volume_id": "7be7a83e-4674-4f18-9ad9-3b0e8132358f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-884107254"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:36.313287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8acec535-6c8d-46ea-a4d2-2f6da27215cc tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.401620 May 10 14:01:36.320010 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 6/9] 10.222.0.32 () {60 vars in 1161 bytes} [Tue May 10 14:01:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:36.325443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-49b5b4b1-a6df-48ae-9586-6297d4ba11e0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Calling method '.version_select at 0x7efd581384c0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:36.381629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-49b5b4b1-a6df-48ae-9586-6297d4ba11e0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] HTTP exception thrown: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-49b5b4b1-a6df-48ae-9586-6297d4ba11e0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Request method failure captured: May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5 HTTP/1.1 May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienA5HkaBySrHV4-i7EM7KKNAQ_dldYanZ9pPBUPHwl7gRDi2fTgHVN7jq1-Lc-CDadLZd5KEZMt4XpjEpH4wIFLKRBuU_sjQuUIg_Vkpe4D-LfdLhxtGC1xQ9Hmbh9ZpVNzs3bauidzXsy8eCITR8BCZOr1MRoi7d-3saCFq3vzPCJs May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 4f5468859afd431c89cb34c8957d60dd May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesGetTestJSON-11202794 May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:01:36.386187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/4f5468859afd431c89cb34c8957d60dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/4f5468859afd431c89cb34c8957d60dd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/4f5468859afd431c89cb34c8957d60dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_4f5468859afd431c89cb34c8957d60dd", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesGetTestJSON-11202794 May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 4f5468859afd431c89cb34c8957d60dd May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesGetTestJSON-11202794 May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesGetTestJSON-11202794-project May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: bb7cdb21321c4ca49c3d273a2439a928 May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesGetTestJSON-11202794-project May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '404a412c-5ba0-4062-8aea-eb825ba643e5'} May 10 14:01:36.387758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. (HTTP 404) (Request-ID: req-4b169498-0be3-49d6-b1a4-5e7e3a1ded65) May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:36.388661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:36.393504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:01:36.396740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-49b5b4b1-a6df-48ae-9586-6297d4ba11e0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] Returning 404 to user: Volume 404a412c-5ba0-4062-8aea-eb825ba643e5 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-49b5b4b1-a6df-48ae-9586-6297d4ba11e0 tempest-VolumesGetTestJSON-11202794 tempest-VolumesGetTestJSON-11202794-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5" status: 404 len: 109 microversion: 2.1 time: 0.066545 May 10 14:01:36.406883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 7/10] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:36 2022] GET /compute/v2.1/os-volumes/404a412c-5ba0-4062-8aea-eb825ba643e5 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:36.410453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1256d3db-08c2-4fee-8d5b-d27f145278b0 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd587015e0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:36.469334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1256d3db-08c2-4fee-8d5b-d27f145278b0 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.079120 May 10 14:01:36.470611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 8/11] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:36 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:36.480155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a6df85a7-380c-46f8-a572-7d40a74788df tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd58138e50>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:36.599286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a6df85a7-380c-46f8-a572-7d40a74788df tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.122093 May 10 14:01:36.600338 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 9/12] 10.222.0.32 () {58 vars in 1139 bytes} [Tue May 10 14:01:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:01:36.610757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ce4bde86-361a-426d-bcab-3ae86d0e8c6e tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd5809fe50>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:36.691605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ce4bde86-361a-426d-bcab-3ae86d0e8c6e tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.084875 May 10 14:01:36.693610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 10/13] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:36 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:01:36.704415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:01:36.705489 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:01:36.706145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:01:36.706757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:01:36.707360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:01:36.742853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:36.746545 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:36.763394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:36.764766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:36.835624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d145ac08-e45f-4c5c-a4c6-0720c08f4228 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd580b3550>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:36.879291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Getting quotas for project db378765a65d4ed59cf60275bc325525. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:36.900110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Getting quotas for user f57a715b890443d78579a056f0a9ff51 and project db378765a65d4ed59cf60275bc325525. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:36.921612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:01:36.941718 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d145ac08-e45f-4c5c-a4c6-0720c08f4228 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fc341901-6b5e-4417-a944-600e06b860d6" status: 200 len: 350 microversion: 2.1 time: 0.110671 May 10 14:01:36.944151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 11/14] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:36 2022] GET /compute/v2.1/os-volumes/fc341901-6b5e-4417-a944-600e06b860d6 => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:36.946656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:01:37.162249 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a80b1da6-1627-4129-a9a9-22637bd3f381 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.823539 May 10 14:01:37.170539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 4/15] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:01:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:01:37.175584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fb9b5063-d971-42a8-b970-f912538981e2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:37.176804 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fb9b5063-d971-42a8-b970-f912538981e2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:37.691958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fb9b5063-d971-42a8-b970-f912538981e2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:37.722061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ecc8ba79-76f5-4409-b4c0-84d8c7ea39aa tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57821ee0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:37.775200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fb9b5063-d971-42a8-b970-f912538981e2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1215 microversion: 2.1 time: 0.603786 May 10 14:01:37.780492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 12/16] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:37 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1215 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:38.141728 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ecc8ba79-76f5-4409-b4c0-84d8c7ea39aa tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.439181 May 10 14:01:38.142484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 5/17] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:37 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:38.795408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c5e86813-50a2-4a92-9d38-e20f3f071a1c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:38.796715 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c5e86813-50a2-4a92-9d38-e20f3f071a1c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:38.952711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c5e86813-50a2-4a92-9d38-e20f3f071a1c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:38.962604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c5e86813-50a2-4a92-9d38-e20f3f071a1c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1215 microversion: 2.1 time: 0.171179 May 10 14:01:38.963837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 13/18] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:38 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:39.154392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bd14b80a-86a9-470c-a84a-292bf59e6b15 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57834670>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:39.206077 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bd14b80a-86a9-470c-a84a-292bf59e6b15 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.056241 May 10 14:01:39.211532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 6/19] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:39 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:39.980308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:39.980929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:40.007796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.023826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.024770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:40.025415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:40.222847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-37ebe8ba-6c94-4415-9c29-3bd0e81ccdb3 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57834d30>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:40.298293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-37ebe8ba-6c94-4415-9c29-3bd0e81ccdb3 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.079499 May 10 14:01:40.299659 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 7/20] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:40 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:40.399515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:40.434443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-da796698-2a95-44ee-b886-0caf9f865e9e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1219 microversion: 2.1 time: 0.444627 May 10 14:01:40.437257 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 14/21] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:39 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1219 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:41.311733 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-75fc2fce-9285-4367-8dba-5e9b2e853f54 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57834a60>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:41.368087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-75fc2fce-9285-4367-8dba-5e9b2e853f54 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.060597 May 10 14:01:41.368716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 8/22] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:41 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:41.454670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:41.455259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:41.470244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:41.476562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:41.477609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:41.478183 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:42.154956 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:42.171360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ee5a9292-1aa6-476c-b798-5678a891f63e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1219 microversion: 2.1 time: 0.714730 May 10 14:01:42.172751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 15/23] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:41 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1219 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:42.379849 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7d65042e-41d0-4da4-8e9e-36cefe0b75d6 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd578343a0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:42.442766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7d65042e-41d0-4da4-8e9e-36cefe0b75d6 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 287 microversion: 2.1 time: 0.067089 May 10 14:01:42.443557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 9/24] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:42 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:42.457166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-31e11816-a172-4d8b-bb5b-3c1c3a709d89 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57fea430>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:42.600049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-31e11816-a172-4d8b-bb5b-3c1c3a709d89 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 202 len: 0 microversion: 2.1 time: 0.149620 May 10 14:01:42.601144 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 16/25] 10.222.0.32 () {58 vars in 1253 bytes} [Tue May 10 14:01:42 2022] DELETE /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:01:42.609958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-16d0f071-c468-433e-a383-d145a8404f06 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57821ee0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:42.700428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-16d0f071-c468-433e-a383-d145a8404f06 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 200 len: 286 microversion: 2.1 time: 0.094825 May 10 14:01:42.701797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 10/26] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:42 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:43.190644 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:43.191465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:43.205602 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:43.215149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:43.216474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:43.218405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:43.456390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-298872d2-9e36-4a4b-81e2-5f9a5a8d0cc4 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd5783f160>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:43.504237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:43.517873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c906cae6-c361-467e-9703-726243c46418 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1273 microversion: 2.1 time: 0.329366 May 10 14:01:43.522997 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 17/27] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:43 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:43.575387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-298872d2-9e36-4a4b-81e2-5f9a5a8d0cc4 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/ec4eb8c6-d6a0-44ee-b5a1-c117d2fefe85" status: 200 len: 349 microversion: 2.1 time: 0.122936 May 10 14:01:43.586224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 11/28] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:43 2022] GET /compute/v2.1/os-volumes/ec4eb8c6-d6a0-44ee-b5a1-c117d2fefe85 => generated 349 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:43.602078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-886fc52a-ba32-4b70-9eb9-b5a4b0b8e0ab tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd5800c280>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:43.715425 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4bbaf155-ccc8-4479-8d0a-ad3ad3015317 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57821a60>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:43.824548 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-886fc52a-ba32-4b70-9eb9-b5a4b0b8e0ab tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.227841 May 10 14:01:43.835366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 18/29] 10.222.0.32 () {58 vars in 1133 bytes} [Tue May 10 14:01:43 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:43.841147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-42ef9213-b9fa-4cd8-9fcd-ff6f1a08adfd tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd57fce9d0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:43.872243 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-4bbaf155-ccc8-4479-8d0a-ad3ad3015317 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] HTTP exception thrown: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4bbaf155-ccc8-4479-8d0a-ad3ad3015317 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Request method failure captured: May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e HTTP/1.1 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienA8YUqMHocEkF88O95kM2B9d9u8L1nZJ9RN2wHwu3l-84oahDsfAsm6JvqWAGa9l3S5EmPGCiFXbO6j-HUnVAB0kHdYdnqXZex9UarMq9wXSw2rluNc4hlWi4a8VJaj-i9q6XDGBYqTmb7OmJKPJQAVFPOMy3YIUTNC9S1h_OvceTU May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:01:43.876962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e21b6bba67764b7989197eda3f4c6804", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: e144879406f14a10818dcc702ecf6a81 May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e'} May 10 14:01:43.877959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. (HTTP 404) (Request-ID: req-e241b998-4906-4d91-8cff-d6d97ae6665b) May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.878630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:43.879525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 14:01:43.881182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. May 10 14:01:43.882080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:43.884718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4bbaf155-ccc8-4479-8d0a-ad3ad3015317 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Returning 404 to user: Snapshot e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:43.885769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4bbaf155-ccc8-4479-8d0a-ad3ad3015317 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e" status: 404 len: 111 microversion: 2.1 time: 0.176049 May 10 14:01:43.889946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 12/30] 10.222.0.32 () {58 vars in 1250 bytes} [Tue May 10 14:01:43 2022] GET /compute/v2.1/os-snapshots/e0544fbb-2fe6-4f72-9c29-cdbea7c44c7e => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:43.911134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ab0a8705-4b56-404f-999f-5223df0b9e39 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd58678f70>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:44.080580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ab0a8705-4b56-404f-999f-5223df0b9e39 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 202 len: 0 microversion: 2.1 time: 0.189214 May 10 14:01:44.081439 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 13/31] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:01:43 2022] DELETE /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:01:44.091255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d9d69c45-db99-4fdf-802b-22662e90784d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd5783f700>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:44.262178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-42ef9213-b9fa-4cd8-9fcd-ff6f1a08adfd tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.425318 May 10 14:01:44.263078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 19/32] 10.222.0.32 () {58 vars in 1148 bytes} [Tue May 10 14:01:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:01:44.277836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-07eb314c-cb13-4f0a-ac59-6aafd5972d21 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd57fcec10>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:44.308624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d9d69c45-db99-4fdf-802b-22662e90784d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 200 len: 345 microversion: 2.1 time: 0.222079 May 10 14:01:44.309672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 14/33] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:44 2022] GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:44.531774 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-07eb314c-cb13-4f0a-ac59-6aafd5972d21 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.257173 May 10 14:01:44.532352 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 20/34] 10.222.0.32 () {58 vars in 1133 bytes} [Tue May 10 14:01:44 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:44.545245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:44.547010 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:44.573460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:44.573920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:44.574829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:44.575274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:44.808169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:44.816712 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-43a92fd5-c0ef-4d25-9ac2-233caa570059 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1273 microversion: 2.1 time: 0.276303 May 10 14:01:44.821509 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 21/35] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:44 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:44.843293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e9ae33c0-aee7-4a85-8d2d-481cbeccc619 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd57fce8b0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.098128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e9ae33c0-aee7-4a85-8d2d-481cbeccc619 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.275105 May 10 14:01:45.108772 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 22/36] 10.222.0.32 () {58 vars in 1166 bytes} [Tue May 10 14:01:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:45.113811 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3b16c567-beea-4ebe-8c5a-f9094d5779a2 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd5800c430>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.360304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3b16c567-beea-4ebe-8c5a-f9094d5779a2 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.250197 May 10 14:01:45.384614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 23/37] 10.222.0.32 () {58 vars in 1169 bytes} [Tue May 10 14:01:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:45.392243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-206ad75e-d267-4206-ba09-516382f5dca4 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd57f63670>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.475901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-206ad75e-d267-4206-ba09-516382f5dca4 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] HTTP exception thrown: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-206ad75e-d267-4206-ba09-516382f5dca4 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Request method failure captured: May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f HTTP/1.1 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienA8YUqMHocEkF88O95kM2B9d9u8L1nZJ9RN2wHwu3l-84oahDsfAsm6JvqWAGa9l3S5EmPGCiFXbO6j-HUnVAB0kHdYdnqXZex9UarMq9wXSw2rluNc4hlWi4a8VJaj-i9q6XDGBYqTmb7OmJKPJQAVFPOMy3YIUTNC9S1h_OvceTU May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:01:45.479379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e21b6bba67764b7989197eda3f4c6804", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: e144879406f14a10818dcc702ecf6a81 May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '7be7a83e-4674-4f18-9ad9-3b0e8132358f'} May 10 14:01:45.480366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. (HTTP 404) (Request-ID: req-dc3d1cb7-c934-48e8-bcf0-afbb18d7dec5) May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.481163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:45.482009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:01:45.483178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.484016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-206ad75e-d267-4206-ba09-516382f5dca4 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Returning 404 to user: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:45.484554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-206ad75e-d267-4206-ba09-516382f5dca4 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 404 len: 109 microversion: 2.1 time: 0.098174 May 10 14:01:45.485811 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 24/38] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:45 2022] GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:45.501450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6946ff4a-bda2-49cd-b6e6-b33cfca1e318 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd57fceee0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.681325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c1f71625-8121-493d-b71a-d61a8c34dcb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: .version_select at 0x7efd5783fb80>, body: {"keypair": {"name": "tempest-keypair-766251379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkMda/NJ+IgKoqPrrQ9FARnP4gkdGWo4NB8ZFdIR8sfif/1odVaGAlo7HzowCq0ANe+8EEQHGzjVcgeMVQHIQOvQh+Ll7Qe/+gSCG3G8Kq8EqumsOvYm9L8CI7s0eN9Uw=="}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:45.717860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6946ff4a-bda2-49cd-b6e6-b33cfca1e318 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.231707 May 10 14:01:45.718476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 25/39] 10.222.0.32 () {58 vars in 1154 bytes} [Tue May 10 14:01:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:45.726108 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2121d1ca-450d-4b8b-aaee-16d8291242e1 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd5800c310>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:45.781272 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-c1f71625-8121-493d-b71a-d61a8c34dcb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:45.790513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-c1f71625-8121-493d-b71a-d61a8c34dcb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:45.803882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-2121d1ca-450d-4b8b-aaee-16d8291242e1 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] HTTP exception thrown: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2121d1ca-450d-4b8b-aaee-16d8291242e1 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Request method failure captured: May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f HTTP/1.1 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienA8YUqMHocEkF88O95kM2B9d9u8L1nZJ9RN2wHwu3l-84oahDsfAsm6JvqWAGa9l3S5EmPGCiFXbO6j-HUnVAB0kHdYdnqXZex9UarMq9wXSw2rluNc4hlWi4a8VJaj-i9q6XDGBYqTmb7OmJKPJQAVFPOMy3YIUTNC9S1h_OvceTU May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:01:45.806311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e21b6bba67764b7989197eda3f4c6804", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: e144879406f14a10818dcc702ecf6a81 May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '7be7a83e-4674-4f18-9ad9-3b0e8132358f'} May 10 14:01:45.807613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. (HTTP 404) (Request-ID: req-c789ca07-7adc-4748-be58-878c19854c5d) May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.811544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:01:45.813251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:01:45.814359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2121d1ca-450d-4b8b-aaee-16d8291242e1 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Returning 404 to user: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2121d1ca-450d-4b8b-aaee-16d8291242e1 tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 404 len: 109 microversion: 2.1 time: 0.088078 May 10 14:01:45.815433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 26/40] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:01:45 2022] DELETE /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:45.907486 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c1f71625-8121-493d-b71a-d61a8c34dcb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.414863 May 10 14:01:45.921981 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 15/41] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:01:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:45.948748 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a58c1148-6a13-4179-b542-f5ba9db6491b tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd56f9d700>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:46.250947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a58c1148-6a13-4179-b542-f5ba9db6491b tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.327464 May 10 14:01:46.252224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 16/42] 10.222.0.32 () {58 vars in 1187 bytes} [Tue May 10 14:01:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:01:46.265778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-454e650e-b884-4a9c-99ed-89375e08ce2d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Calling method '.version_select at 0x7efd56fb63a0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:46.316272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-504892811", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:46.325443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-454e650e-b884-4a9c-99ed-89375e08ce2d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] HTTP exception thrown: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-454e650e-b884-4a9c-99ed-89375e08ce2d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Request method failure captured: May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f HTTP/1.1 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienA8YUqMHocEkF88O95kM2B9d9u8L1nZJ9RN2wHwu3l-84oahDsfAsm6JvqWAGa9l3S5EmPGCiFXbO6j-HUnVAB0kHdYdnqXZex9UarMq9wXSw2rluNc4hlWi4a8VJaj-i9q6XDGBYqTmb7OmJKPJQAVFPOMy3YIUTNC9S1h_OvceTU May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:01:46.328492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e21b6bba67764b7989197eda3f4c6804"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e21b6bba67764b7989197eda3f4c6804", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: e21b6bba67764b7989197eda3f4c6804 May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-612804571 May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: e144879406f14a10818dcc702ecf6a81 May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesSnapshotsTestJSON-612804571-project May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '7be7a83e-4674-4f18-9ad9-3b0e8132358f'} May 10 14:01:46.329727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. (HTTP 404) (Request-ID: req-1ab591e5-9d57-4d4b-b0ba-f8689d659468) May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:46.330583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:01:46.331809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:01:46.333700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. May 10 14:01:46.335075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:01:46.336692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-454e650e-b884-4a9c-99ed-89375e08ce2d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] Returning 404 to user: Volume 7be7a83e-4674-4f18-9ad9-3b0e8132358f could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:01:46.337805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-454e650e-b884-4a9c-99ed-89375e08ce2d tempest-VolumesSnapshotsTestJSON-612804571 tempest-VolumesSnapshotsTestJSON-612804571-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f" status: 404 len: 109 microversion: 2.1 time: 0.084489 May 10 14:01:46.338648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 17/43] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:01:46 2022] GET /compute/v2.1/os-volumes/7be7a83e-4674-4f18-9ad9-3b0e8132358f => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:01:46.357083 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:46.363261 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:46.435856 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:46.436625 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:46.441442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:46.445272 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:46.650038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] validate_networks() for [('c48a28d6-d3fb-47b6-bcca-bb27d9f57474', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:01:47.316830 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:47.349013 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b07a1bc0-33e4-42f6-a508-a09ceff99424 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 1.009104 May 10 14:01:47.360690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 18/44] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:46 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:47.374167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-369747ff-9328-4466-b521-0bef5db83085 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] Calling method '.version_select at 0x7efd566cdb80>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:47.626559 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-369747ff-9328-4466-b521-0bef5db83085 tempest-VolumesTestJSON-1368116207 tempest-VolumesTestJSON-1368116207-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.264328 May 10 14:01:47.627126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 19/45] 10.222.0.32 () {58 vars in 1154 bytes} [Tue May 10 14:01:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:48.378038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:48.379527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:48.393238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:48.396706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:48.400974 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:48.400974 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:48.945752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:48.961328 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8be3cc8b-aa91-4d82-9eda-9480b8f8654a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.584141 May 10 14:01:48.962688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 20/46] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:48 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:49.268357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:01:49.268857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:01:49.269425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:01:49.269954 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:01:49.270542 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:01:49.298101 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:49.299034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:49.302248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:49.303177 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:49.426422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:49.465784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for user 1897b88622664ceca4deac5a22079726 and project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:49.515756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:01:49.533874 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:01:49.751103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1932095f-f290-4cc1-80bd-87623420e7de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.941341 May 10 14:01:49.753758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 27/47] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:01:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:01:49.763976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-08e6febc-bbdd-456f-8ef9-5536a128e92c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:49.764809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-08e6febc-bbdd-456f-8ef9-5536a128e92c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:49.980187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:49.981689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:50.009678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:50.010368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:50.012573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:50.013897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:50.070729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-08e6febc-bbdd-456f-8ef9-5536a128e92c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:50.091665 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-08e6febc-bbdd-456f-8ef9-5536a128e92c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1221 microversion: 2.1 time: 0.331621 May 10 14:01:50.107353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 21/48] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:49 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1221 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:50.427867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1974001236", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:50.559407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] validate_networks() for [('c48a28d6-d3fb-47b6-bcca-bb27d9f57474', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:01:50.579427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:50.587236 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-06364c1c-cb48-4b5c-a189-d559b5627c0e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.611918 May 10 14:01:50.593200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 28/49] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:49 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:51.604896 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:51.605543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:51.617802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:51.618282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:51.622442 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:51.627893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:51.977496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:52.005488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f5c864c1-c648-4ebb-8b6f-2a76943a11ac tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.401865 May 10 14:01:52.006567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 29/50] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:51 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:53.025856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:53.027332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:53.036716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.042903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.048217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.050794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.287313 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:01:53.287808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:01:53.288226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:01:53.288815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:01:53.289389 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:01:53.307042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.307519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.308361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:53.308752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:53.405822 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:53.432506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for user 1897b88622664ceca4deac5a22079726 and project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:53.528037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:01:53.535407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:01:53.704805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0bd4779c-f92a-4eab-b953-a2be100d5262 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.282153 May 10 14:01:53.715114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 22/51] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:01:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:01:53.741469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9f6b4ef8-c357-4268-8f19-e296e586e686 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:53.742805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9f6b4ef8-c357-4268-8f19-e296e586e686 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:53.990269 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:54.006373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-375d0ae0-0fd5-4dab-81e5-c2ec0ff7b421 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.976660 May 10 14:01:54.018639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 30/52] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:53 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:54.037650 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9f6b4ef8-c357-4268-8f19-e296e586e686 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:54.055297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9f6b4ef8-c357-4268-8f19-e296e586e686 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1222 microversion: 2.1 time: 0.331948 May 10 14:01:54.057350 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 23/53] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:53 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1222 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:54.138026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1556929957", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c07cd0-6152-43ba-84e4-0ef3e3d224df"}], "security_groups": [{"name": "tempest-securitygroup--632598763"}], "key_name": "tempest-keypair-766251379", "user_data": "}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:54.457009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] validate_networks() for [('49c07cd0-6152-43ba-84e4-0ef3e3d224df', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:01:54.821702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-ba054d46-9535-4ddd-91e6-fe17bf57a7ce req-a9602ec5-4f72-4c93-8381-ca082374ed4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f772bda-ce73-4ac2-aa73-28852bfa8b92", "tag": "30a4e6db-5223-416e-8dbe-46ef6ea6be27"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:01:54.834336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ba054d46-9535-4ddd-91e6-fe17bf57a7ce req-a9602ec5-4f72-4c93-8381-ca082374ed4e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.841954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ba054d46-9535-4ddd-91e6-fe17bf57a7ce req-a9602ec5-4f72-4c93-8381-ca082374ed4e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.871520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-ba054d46-9535-4ddd-91e6-fe17bf57a7ce req-a9602ec5-4f72-4c93-8381-ca082374ed4e service nova] Creating event network-changed:30a4e6db-5223-416e-8dbe-46ef6ea6be27 for instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 on hv-cinder-83588 May 10 14:01:54.872703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ba054d46-9535-4ddd-91e6-fe17bf57a7ce req-a9602ec5-4f72-4c93-8381-ca082374ed4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117185) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:01:54.874112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.874765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.875729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:54.876169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:54.887183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.compute.rpcapi [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:01:54.888259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117185) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:01:54.905971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b36747ff-3d99-4cb1-9335-24408b1edfb8 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147265 May 10 14:01:54.906617 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 24/54] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:01:54.998567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:01:54.998998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:01:54.999457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:01:54.999869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:01:55.000282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:01:55.009688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.009985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.010832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.011270 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.026483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:55.027378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.029865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:01:55.034465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:01:55.038136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.038834 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.039634 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.040080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.046020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:01:55.048369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:01:55.095516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-95f44d1c-a533-4573-b530-825f6125b748 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.962335 May 10 14:01:55.102193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 31/55] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:01:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:01:55.106029 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:55.106699 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.112999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.113461 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.114915 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:55.115364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:55.174447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:55.184183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0a59e641-0ad9-40cc-80dd-c5088456233c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.162185 May 10 14:01:55.193483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 25/56] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:55 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:55.193667 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:55.194133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-28142715-98a9-4ce5-bcc6-ee8c5130e48c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:55.194133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-28142715-98a9-4ce5-bcc6-ee8c5130e48c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:55.199508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3b7143d5-07c9-4881-99af-1c836bde7816 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.101937 May 10 14:01:55.200335 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 32/57] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:55 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:55.250688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-28142715-98a9-4ce5-bcc6-ee8c5130e48c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:55.257962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-28142715-98a9-4ce5-bcc6-ee8c5130e48c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1241 microversion: 2.1 time: 0.071584 May 10 14:01:55.258601 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 26/58] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:55 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:56.201074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:56.201625 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:56.208403 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.208860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.209632 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.210070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.216701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:56.217343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:56.223986 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.224507 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.225227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.225662 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.288585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:56.295939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2bb7d2d4-b12f-4a73-a066-338a52d68925 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.082972 May 10 14:01:56.302494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 27/59] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:56 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:56.309953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:56.310807 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:56.317726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.318420 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.319539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:56.319895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:56.351132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:56.358499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-10e9c2f5-990e-4247-9e99-3ea63569b514 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.161375 May 10 14:01:56.359076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 33/60] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:56 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:56.381538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:56.389037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5f8e8f77-37c1-4872-856b-c81ad5d9e874 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.085115 May 10 14:01:56.389608 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 28/61] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:56 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:57.312845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:57.313463 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:57.320334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.320787 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.321553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.321989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.376280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:57.376901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:57.381200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:57.383615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.384552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.384861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.385304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.388395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-11d9a563-93e8-473d-bdad-79c8c302f615 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.079421 May 10 14:01:57.388961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 34/62] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:57 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:57.411532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:57.412146 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:57.418268 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.418738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.419528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:57.419974 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:57.486488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:57.494697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dd8141a1-c522-4108-abca-59146677cf96 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.086915 May 10 14:01:57.495263 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 35/63] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:57 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:57.520438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:57.527945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d433e322-3e64-4f6f-b209-7f39cb7d717c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.155515 May 10 14:01:57.528464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 29/64] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:57 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:58.404853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:58.405473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.411694 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.412180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.412958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.413408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.485952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:58.499087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-969c975b-2894-4194-9a5b-3916019eb1e5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.097994 May 10 14:01:58.499672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 36/65] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:58.512631 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:58.513928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.521308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.522160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.522991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.523437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.544943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:58.545573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:58.552044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.552508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.553303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:58.553767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:58.589624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:58.597681 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-614cc993-055c-4bda-9337-7c7da882c9cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.090012 May 10 14:01:58.605219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 30/66] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:58.711901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:58.721499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-efb40637-fcb5-4429-a7ce-f1879d4a3b32 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.180301 May 10 14:01:58.722337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 37/67] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:58 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:01:59.515638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:59.516150 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:59.522960 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.523457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.524277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.524819 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.589181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.596609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-43dbc7d3-a68e-4765-8194-ab19d4cf9729 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.084967 May 10 14:01:59.597193 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 31/68] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:59 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:59.616116 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:59.617007 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:59.622919 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.623369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.624134 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.624571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.695519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.703494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bbfef486-fe4e-4836-a8f8-6c03e87d0663 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.091684 May 10 14:01:59.704360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 38/69] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:59 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:01:59.739923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:01:59.741067 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:01:59.748694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.749305 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.750261 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:01:59.751726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:01:59.961867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:01:59.969393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-86bf4ebe-c051-4072-bdf7-8f36e9071128 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.233653 May 10 14:01:59.970429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 32/70] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:01:59 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:00.614982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.615590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.621532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.622115 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.622758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.623218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.685781 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.692946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-47b99224-bf1a-4dad-9fa7-9b804125a382 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.082492 May 10 14:02:00.693504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 39/71] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:00.722753 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.724206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.729891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.730394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.731163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.731603 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.791469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:00.798620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bea2ab8c-c94e-4545-85b7-a04d848d53ae tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.079715 May 10 14:02:00.799194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 33/72] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:00.987201 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:00.988152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:00.995456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.996197 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:00.997212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:00.997865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.125405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:01.132562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dfdeae67-0a05-48e6-8831-6a2f65e84342 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.149238 May 10 14:02:01.133117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 40/73] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:00 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:01.709815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:01.710505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:01.716482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.716943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.717718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.718162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.783686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:01.792281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-47b94dd1-4c54-4ba2-af6e-0aeaae2ef7b0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.086865 May 10 14:02:01.792857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 34/74] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:01 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:01.816260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:01.816871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:01.822879 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.823321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.824071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:01.824499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:01.885694 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:01.892870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a379134c-9444-4e25-9293-1e4476f7aac7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.080406 May 10 14:02:01.893374 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 41/75] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:01 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:02.149651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:02.150216 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:02.156222 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.156688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.157481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.157928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.283851 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.291387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b9b46886-50c6-421b-b599-6460f9cd61bd tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.146431 May 10 14:02:02.291965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 35/76] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:02 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:02.809341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:02.809955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:02.815924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.816378 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.817777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.818229 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.877958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.886068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e8c7dc7f-c181-479f-9a0c-34c71eeb3c6e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.080581 May 10 14:02:02.886652 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 42/77] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:02 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:02.910095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:02.911313 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:02.917203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.917596 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.918379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:02.918814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:02.977433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:02.984731 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5f60d8ab-191b-4ada-8be9-2f78b465fe81 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.078406 May 10 14:02:02.985289 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 36/78] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:02 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:03.308070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:03.308757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:03.314797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.315309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.316131 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.316562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.443757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:03.470153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4a13fd68-75d2-4776-86dc-d644fa09b90b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.165686 May 10 14:02:03.471078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 43/79] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:03.902785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:03.903407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:03.910866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.911500 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:03.918539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:03.918991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.002524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:04.003148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:04.015666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.016112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.017088 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.017674 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.059773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.068896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cbfc5ede-a220-419b-8e24-53e4de0d228f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1226 microversion: 2.1 time: 0.170015 May 10 14:02:04.077605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 37/80] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:04.160040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.168262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-183b0f96-a58b-4f34-aeb5-245dbb045966 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1245 microversion: 2.1 time: 0.169484 May 10 14:02:04.168851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 44/81] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:03 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:04.490161 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:04.490161 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:04.499239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.499691 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.500484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:04.500927 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:04.778245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:04.787613 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c4381f8c-3591-4df6-93c4-736b67226403 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.302696 May 10 14:02:04.788387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 38/82] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:04 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:05.090429 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:05.091050 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:05.097133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.097801 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.099480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.099952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.186327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:05.187049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:05.196749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.197426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.199328 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.199917 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.213317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:05.222233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d86935e9-b28a-4e1e-8fc6-d6725cc4b6b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1282 microversion: 2.1 time: 0.136381 May 10 14:02:05.224639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 45/83] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:05 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:05.344408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:05.357967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3289fe6c-6e8c-42d1-bdaf-89bc98cbc257 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1293 microversion: 2.1 time: 0.174886 May 10 14:02:05.359408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 39/84] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:05 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1293 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:05.804958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:05.805563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:05.814530 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.818329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:05.819357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:05.820085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.178748 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.188448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f403f7f9-fdea-4a5f-bf5f-e89ca0a58511 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.387292 May 10 14:02:06.191298 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 46/85] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:05 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:06.242921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:06.243523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:06.250226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.250910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.252288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.252888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.374303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.375942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:06.376721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:06.382827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.383482 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.384422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:06.384994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:06.385189 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1675ebc3-56ae-438b-b696-e91bc2852a61 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1280 microversion: 2.1 time: 0.148351 May 10 14:02:06.397614 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 40/86] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:06 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:06.463936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:06.475878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b5a5f083-4ada-45fd-8033-8736ff09ec19 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1299 microversion: 2.1 time: 0.103759 May 10 14:02:06.485091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 47/87] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:06 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:07.208139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.209162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.221451 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.222062 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.225049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.226557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.407345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.410173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.419136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.420360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.428792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.430425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.542295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.551230 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f674e244-dd89-470a-acd6-44d92a3ae18b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.347875 May 10 14:02:07.554815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 41/88] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:07.563847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:07.564844 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:07.591617 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.592685 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.593724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.595687 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.648441 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.656136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2c858a38-6031-4acb-b48c-d5cf85e7ac97 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.254783 May 10 14:02:07.657084 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 48/89] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:07.725920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-d4e83c45-0a73-4c4e-8f6d-ac0fba08043d req-707fe689-6b60-40bd-9f2b-ae9f349ca861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8618c48-35fd-41ab-975f-ae42c69a6a94", "tag": "7fcebda4-a245-47da-98d3-1c315a7310e9"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:07.737908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d4e83c45-0a73-4c4e-8f6d-ac0fba08043d req-707fe689-6b60-40bd-9f2b-ae9f349ca861 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.738851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d4e83c45-0a73-4c4e-8f6d-ac0fba08043d req-707fe689-6b60-40bd-9f2b-ae9f349ca861 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.759848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-d4e83c45-0a73-4c4e-8f6d-ac0fba08043d req-707fe689-6b60-40bd-9f2b-ae9f349ca861 service nova] Creating event network-changed:7fcebda4-a245-47da-98d3-1c315a7310e9 for instance f8618c48-35fd-41ab-975f-ae42c69a6a94 on hv-cinder-83588 May 10 14:02:07.760389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d4e83c45-0a73-4c4e-8f6d-ac0fba08043d req-707fe689-6b60-40bd-9f2b-ae9f349ca861 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 14:02:07.761724 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.762149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.762965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:07.763394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:07.773397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.compute.rpcapi [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 14:02:07.774558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] Releasing lock "compute-rpcapi-router" {{(pid=117186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 14:02:07.791671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6efbfade-3cc3-4e63-bcca-5ec2a244ac14 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133255 May 10 14:02:07.792555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 49/90] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:07.937350 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:07.948016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6fcb3160-3b37-4fe8-9de2-d82559852980 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.390928 May 10 14:02:07.948597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 42/91] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:07 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:08.581734 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:08.581734 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.583352 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.583795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.584560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.585024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.673421 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:08.674031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.680092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.680539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.681305 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.681735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.724936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:08.732462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bc0f28a2-f459-4e52-b4d8-513861161a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.160728 May 10 14:02:08.733032 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 50/92] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:08 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:08.815656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:08.823706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7b1b57e0-6518-4b27-a905-f571ea42b48d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.154114 May 10 14:02:08.824359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 43/93] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:08 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:08.964498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:08.965296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:08.971347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.971869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:08.972705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:08.973737 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.099478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.107323 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3c073824-ae4d-4859-9677-6746aafa1568 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.146420 May 10 14:02:09.107900 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 51/94] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:08 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:09.748732 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:09.749364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:09.755583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.756115 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.756989 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.757501 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.842189 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:09.842937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:09.851670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.852595 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.853555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:09.854173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:09.903197 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:09.911918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e9a84356-4850-4c26-97f7-2fbca64865f5 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.166935 May 10 14:02:09.912558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 44/95] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:09 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.125487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.126162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.133683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.134447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.135387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.135823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.152800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.161041 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-aeed36c9-9433-4192-888d-d8af00152bbc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.323447 May 10 14:02:10.162727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 52/96] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:09 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:10.274758 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:10.282017 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3099fc7a-67f7-4c7f-8b98-00a7c8407973 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.160789 May 10 14:02:10.282591 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 45/97] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:10.929580 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:10.930193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:10.936095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.936546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:10.937315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:10.937752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.072178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.079524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6e9e1a30-f869-42f1-a9d4-be27c4076e6e tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.154465 May 10 14:02:11.080335 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 53/98] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:10 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:11.178731 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.179374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.185220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.185673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.186468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.186906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.298325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:11.299243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:11.307438 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.308090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.309037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:11.309641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:11.325375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.334972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9856236b-d53b-45be-bf42-7d7da73c5fcd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.160596 May 10 14:02:11.336103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 46/99] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:11.472722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:11.480837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7ec24ed2-4c91-4399-972e-4522232bcab7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.186267 May 10 14:02:11.481650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 54/100] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:11 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:12.095940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.096645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.103257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.103738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.104573 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.105053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.235306 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.245208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5658b116-1fcb-4976-8606-f5e6a909b9a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.152243 May 10 14:02:12.245805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 47/101] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:12.352314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.352932 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.359074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.359551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.360348 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.360775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.493019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.497039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:12.497661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:12.500843 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-44b27965-df9e-485c-b1af-00676eb3cc0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.153198 May 10 14:02:12.501520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 55/102] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:12.503750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.504414 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.505335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:12.505941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:12.639200 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:12.647133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c6b6a5d2-fe3c-4724-9121-dfc872ec194d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.153775 May 10 14:02:12.647725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 48/103] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:12 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:13.261520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.262155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.268541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.268995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.270306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.270942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.405810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.413937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9bf56a79-abc5-45bd-a997-edf443e5aaf9 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.156496 May 10 14:02:13.414650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 56/104] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:13.518381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.518995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.526080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.526587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.527434 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.527966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.664986 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:13.665613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:13.671908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.672368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.673144 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:13.673582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:13.682912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.690637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b020bbb9-b262-482e-8d67-834acbd00b51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.176616 May 10 14:02:13.692346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 49/105] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:13.802941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:13.810209 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-235e97a7-a0b4-43de-8154-f4a49fad396d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.150149 May 10 14:02:13.810811 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 57/106] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:13 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:14.430885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.431504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.437444 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.437896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.438699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.439139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.568419 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.575583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c3b5fbc8-47bb-4653-8528-aba3d02e5892 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.148688 May 10 14:02:14.576158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 50/107] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:14.707531 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.708081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.715486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.715938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.716733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.717157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.827093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:14.827703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:14.834109 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.834596 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.835485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:14.835920 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:14.847134 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.855491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-70cd30cf-d36b-46ea-a887-8414c492a8ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.151853 May 10 14:02:14.856289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 58/108] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:14.967472 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:14.974755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b22da404-c620-4c21-890e-fb18f2fb57c8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.151506 May 10 14:02:14.975295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 51/109] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:14 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:15.592756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.593370 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.600520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.600968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.601729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.602169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.732321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:15.740341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5a6a07b5-5f7d-4629-9603-119755a9c2d6 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.150767 May 10 14:02:15.740908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 59/110] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:15.871947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.872564 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.878503 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.878954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.879719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.880195 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:15.992682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:15.993297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:15.999140 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:15.999592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.000365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.000803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.004790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.014342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2367df5e-53f6-4450-90ea-38ac32fe0516 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.146056 May 10 14:02:16.019186 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 52/111] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:16.132303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.139567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-57e5745a-e92b-428f-b98d-6d69b89d444f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.152083 May 10 14:02:16.140138 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 60/112] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:15 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:16.757262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:16.758032 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:16.763885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.764340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.765092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:16.765523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:16.895877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:16.903870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-84648c8f-78e6-428c-b38a-1beddd0aa838 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.151094 May 10 14:02:16.904438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 53/113] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:16 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:17.032609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.033330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.040676 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.041132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.042607 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.043112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.156945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.157568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.170858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.172428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.173250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.173875 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.207284 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.218223 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2201cd50-969f-41e2-b6fa-3c133ff4d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.189602 May 10 14:02:17.228676 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 61/114] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:17.352324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:17.364307 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-fe0f26da-9323-4f96-b32d-2e86b75abe23 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.211344 May 10 14:02:17.365894 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 54/115] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:17.921677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:17.922423 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:17.932376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.933937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:17.937351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:17.937977 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.137097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.155215 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ccb96deb-653e-4dfd-95fa-2c6ba5f752a1 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.236529 May 10 14:02:18.168681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 62/116] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:17 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:18.235265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.235927 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.242769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.243238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.244200 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.244770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.383609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:18.384231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:18.393726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.394185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.394995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.395432 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.723567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:18.734491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-90aa31c0-efdd-4aa9-a49e-4a10ab52f868 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.353973 May 10 14:02:18.737241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 63/117] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:18.743916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-83d9ea2b-19a7-4b29-b738-6d386b8b047d req-f2ef47b4-28e2-4cae-aee6-0c041bf2f168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead53d16-350b-428b-abb0-ee729094fae0", "tag": "fec44231-1d3b-4ecc-b5bb-dddd45402204"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:18.774016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-83d9ea2b-19a7-4b29-b738-6d386b8b047d req-f2ef47b4-28e2-4cae-aee6-0c041bf2f168 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:18.774016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-83d9ea2b-19a7-4b29-b738-6d386b8b047d req-f2ef47b4-28e2-4cae-aee6-0c041bf2f168 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:18.788563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-83d9ea2b-19a7-4b29-b738-6d386b8b047d req-f2ef47b4-28e2-4cae-aee6-0c041bf2f168 service nova] Creating event network-changed:fec44231-1d3b-4ecc-b5bb-dddd45402204 for instance ead53d16-350b-428b-abb0-ee729094fae0 on hv-cinder-83588 May 10 14:02:18.797680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-83d9ea2b-19a7-4b29-b738-6d386b8b047d req-f2ef47b4-28e2-4cae-aee6-0c041bf2f168 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058855 May 10 14:02:18.798387 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 64/118] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:19.010385 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.039029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-36b776e4-258e-4fc1-8f85-f4a48f32bbdd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.804397 May 10 14:02:19.041505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 55/119] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:18 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.176810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.177557 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.192917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.193866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.197881 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.198374 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.224551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-d809f7e0-8ccd-4c18-8798-7a0e0e70438d req-ea753f54-642a-46e9-af2f-0f8affebeb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e464c-7bb4-4da3-b486-18b941be97b9", "tag": "16a28325-933e-48f7-9d78-2defa48a5ac0"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:19.237113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-d809f7e0-8ccd-4c18-8798-7a0e0e70438d req-ea753f54-642a-46e9-af2f-0f8affebeb99 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.239105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-d809f7e0-8ccd-4c18-8798-7a0e0e70438d req-ea753f54-642a-46e9-af2f-0f8affebeb99 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.269010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-d809f7e0-8ccd-4c18-8798-7a0e0e70438d req-ea753f54-642a-46e9-af2f-0f8affebeb99 service nova] Creating event network-changed:16a28325-933e-48f7-9d78-2defa48a5ac0 for instance b01e464c-7bb4-4da3-b486-18b941be97b9 on hv-cinder-83588 May 10 14:02:19.275285 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-d809f7e0-8ccd-4c18-8798-7a0e0e70438d req-ea753f54-642a-46e9-af2f-0f8affebeb99 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055335 May 10 14:02:19.275893 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 56/120] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:19.430162 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.439618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9216344c-5945-4352-aeef-78663b0172aa tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.270696 May 10 14:02:19.440357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 65/121] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:19.753044 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:19.753913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:19.760751 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.761210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.761979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:19.762440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:19.973899 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:19.985563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d12c5c05-96a2-48e7-a744-2b18bbeac750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.236602 May 10 14:02:19.986501 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 57/122] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:19 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:20.059647 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.060419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.073286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.074689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.076936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.078741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.259439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:20.268474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b6c1d4c1-17fc-4ca7-bde3-e06147d01dc8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.214753 May 10 14:02:20.269371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 66/123] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:20.456800 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:20.457622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:20.465737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.466230 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.467006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:20.467443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:20.667779 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:20.675884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3eaf978d-a9e5-41bd-862d-5fd2390638c0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.223174 May 10 14:02:20.676398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 58/124] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:21.004740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:21.006373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:21.012587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.013036 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.013934 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.014257 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.191243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.210308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-86f02e01-7bbd-4640-801b-b40880393a37 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.209235 May 10 14:02:21.210993 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 67/125] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:20 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:21.284760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:21.285368 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:21.291340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.291794 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.292814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.293349 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.458793 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.468332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-598c6614-9a2f-4bba-99ae-f134094a471c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.186819 May 10 14:02:21.470402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 59/126] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:21 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:21.693142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:21.694538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:21.700552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.701073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.702099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:21.702756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:21.852903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:21.870968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-33cded6a-82f1-4c34-ab99-e2cf82d5bc5a tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.181853 May 10 14:02:21.880266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 68/127] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:21 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:22.232215 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.232849 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.238863 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.239325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.240143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.240683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.390860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:22.399898 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2598b3e1-4d37-4a46-87f6-cb4cd427e6a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.171433 May 10 14:02:22.410258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 60/128] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:22.485399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.486009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.492320 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.492764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.493527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.493957 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.707612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:22.716865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-16e963cd-df59-49ec-a1e9-327697b96543 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.235265 May 10 14:02:22.717575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 69/129] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:22.888325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:22.889233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:22.896947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.902987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:22.904180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:22.904767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.372477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.403777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ae921821-ce59-495f-8a1d-e9c19018f3ab tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.519488 May 10 14:02:23.404440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 61/130] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:22 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:23.422956 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.423569 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.431947 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.432800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.433914 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.434563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.681758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.694357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-03d10d5c-e6e1-44a3-a422-0a104cfd9dd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.276524 May 10 14:02:23.695043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 70/131] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:23.733018 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:23.734358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:23.742612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.743297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.744320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:23.744973 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:23.947224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:23.956265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-13125972-6be8-49b3-aba5-ac46ad05e30c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.227096 May 10 14:02:23.956914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 62/132] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:23 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:24.424425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.425674 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.433789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.437176 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.438266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.441967 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.678398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:24.688830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2982dac6-2ae7-4f9b-abd8-16b9ee9fb432 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.266650 May 10 14:02:24.690596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 71/133] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:24.745538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.746920 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.762616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.779554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.780975 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.783159 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.975581 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:24.976634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:24.987454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.988153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:24.990635 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:24.992504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.031075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.042970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-17eefb6f-2799-4661-8a08-86545606472f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.332991 May 10 14:02:25.043527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 63/134] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.214407 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.222648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-88239805-0a6f-4c5e-918b-5482a8ec094e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.252348 May 10 14:02:25.223688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 72/135] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:24 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:25.708827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:25.709454 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:25.716378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.717122 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.719513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:25.720250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:25.909260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:25.934041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-527d1ae6-05e0-4f04-b857-d707b5adadcc tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.227384 May 10 14:02:25.935393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 64/136] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:25 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.061428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.062097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.068735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.073227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.074120 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.074597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.285145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.297003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dd171340-37c4-48ad-95c3-ab8085bc24f3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.240466 May 10 14:02:26.299956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 65/137] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.306216 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.307670 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.316860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.318167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.319677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.320264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.351390 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-af170ffd-b8f1-4688-9b8d-f9d298943327 req-9a5fdad1-2297-4adf-8820-35e4e6ab103b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f772bda-ce73-4ac2-aa73-28852bfa8b92", "name": "network-vif-plugged", "status": "completed", "tag": "30a4e6db-5223-416e-8dbe-46ef6ea6be27"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:26.365842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-af170ffd-b8f1-4688-9b8d-f9d298943327 req-9a5fdad1-2297-4adf-8820-35e4e6ab103b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.366284 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-af170ffd-b8f1-4688-9b8d-f9d298943327 req-9a5fdad1-2297-4adf-8820-35e4e6ab103b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.385459 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-af170ffd-b8f1-4688-9b8d-f9d298943327 req-9a5fdad1-2297-4adf-8820-35e4e6ab103b service nova] Creating event network-vif-plugged:30a4e6db-5223-416e-8dbe-46ef6ea6be27 for instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 on hv-cinder-83588 May 10 14:02:26.391166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-af170ffd-b8f1-4688-9b8d-f9d298943327 req-9a5fdad1-2297-4adf-8820-35e4e6ab103b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.469220 May 10 14:02:26.392202 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 73/138] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:26.511262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:26.518761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-925c1a05-e744-4236-bc20-678fe02a8417 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.217644 May 10 14:02:26.519543 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 66/139] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:26.952578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:26.953729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:26.961792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.962484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:26.963708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:26.964412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.141023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.154697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2679fe0b-cc7e-4c43-b010-3244522ebbca tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.206200 May 10 14:02:27.155285 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 74/140] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:26 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.316622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.318498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.325406 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.325943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.326958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.327605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.514449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.533769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c1cde672-e000-4d75-91ed-5db3ba0be3cb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.220807 May 10 14:02:27.534498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 67/141] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:27.538280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:27.539372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:27.545707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.546528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.548130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:27.548561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:27.704121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:27.713142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-178577a4-a091-4cc0-b74f-e435505bc7ea tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.180556 May 10 14:02:27.713784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 75/142] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:27 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:28.174604 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.175541 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.187788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.188934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.190076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.190752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.378091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.389227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8421540a-7ec5-4d12-ad09-d36a42d4f64b tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.220230 May 10 14:02:28.399767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 68/143] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:28.552120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.554180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.564497 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.569030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.570661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.571304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.706314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.714179 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7e7f5df0-ef2d-4cd0-b7e3-36fb494431da tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.166950 May 10 14:02:28.714772 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 76/144] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:28.729710 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:28.730365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:28.736292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.736746 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.737514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:28.737955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:28.863205 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:28.871292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8e051686-4409-4c45-aaef-10d25f36a635 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.145279 May 10 14:02:28.871963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 69/145] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:28 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:29.406957 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.407575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.413786 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.414268 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.415041 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.415482 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.544097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:29.551290 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-53c811e1-21a7-4f86-91f4-5d4d47fcfb1f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.148141 May 10 14:02:29.551853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 77/146] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:29.738347 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.740009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.748073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.748542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.753015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.753909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.887925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:29.888796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:29.895002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.896093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:29.897566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:29.898369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.096929 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.105294 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-160f3e3c-c2cb-4aa7-8ac5-700080fd8bc2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.377793 May 10 14:02:30.115351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 70/147] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:30.143737 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.152527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e33cf227-714d-4a86-ba99-f8915ed03402 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.268175 May 10 14:02:30.153532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 78/148] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:29 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:30.570462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:30.571147 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:30.577182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.577627 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.578464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:30.579051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:30.957703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:30.965155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b444e6da-bda8-408b-9537-fd977af14cd0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.399142 May 10 14:02:30.965727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 71/149] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:30 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:31.123156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.123859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.130047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.130681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.131332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.131769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.170495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.171282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.178033 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.178252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.178933 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.179368 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.284760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.293451 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f3b043fd-9e72-495f-a1b1-1f3f3aaae4d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.174721 May 10 14:02:31.294033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 79/150] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:31.324993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:31.332609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1a8e9078-acb7-4dd8-8dc6-ed3c6ba0d967 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.165830 May 10 14:02:31.333815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 72/151] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:31.802992 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-ed3cef15-f377-4288-a3cf-f1d9a83083da req-a903ae3f-0b21-4b38-96d6-b62f6284cff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8618c48-35fd-41ab-975f-ae42c69a6a94", "name": "network-vif-plugged", "status": "completed", "tag": "7fcebda4-a245-47da-98d3-1c315a7310e9"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:31.811085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-ed3cef15-f377-4288-a3cf-f1d9a83083da req-a903ae3f-0b21-4b38-96d6-b62f6284cff5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.811528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-ed3cef15-f377-4288-a3cf-f1d9a83083da req-a903ae3f-0b21-4b38-96d6-b62f6284cff5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.827998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-ed3cef15-f377-4288-a3cf-f1d9a83083da req-a903ae3f-0b21-4b38-96d6-b62f6284cff5 service nova] Creating event network-vif-plugged:7fcebda4-a245-47da-98d3-1c315a7310e9 for instance f8618c48-35fd-41ab-975f-ae42c69a6a94 on hv-cinder-83588 May 10 14:02:31.848342 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-ed3cef15-f377-4288-a3cf-f1d9a83083da req-a903ae3f-0b21-4b38-96d6-b62f6284cff5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046596 May 10 14:02:31.849214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 80/152] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:31.982081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:31.982782 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:31.988619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.989073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:31.990564 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:31.991153 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.136459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.146653 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b70a7b22-ade4-4574-a2f1-864a85d0c701 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.168081 May 10 14:02:32.147246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 73/153] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:31 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:32.310084 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.311506 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.323128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.323591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.324393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.324830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.353725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:32.354579 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:32.361693 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.368357 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.369316 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:32.370000 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:32.479937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.487860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7b42f448-5862-4798-b755-9ecc63a3b4eb tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.181716 May 10 14:02:32.488378 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 81/154] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:32.512835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:32.520180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9f419277-9143-4e36-a48e-85826457c331 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.174051 May 10 14:02:32.520825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 74/155] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:32 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:33.163685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.164296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.170070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.170550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.171303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.171730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.303207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.311258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-90cd6f45-b396-4a57-b6c9-79e04c53ba54 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.151569 May 10 14:02:33.311882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 82/156] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:33.505236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.505878 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.511833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.512281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.513045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.513477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.539197 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:33.540013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:33.546654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.547372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.548413 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:33.548923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:33.666042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.666685 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-73c46a11-022b-42f0-a541-4b0f1ae6ccad tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.165550 May 10 14:02:33.667152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 75/157] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:33.692060 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:33.701840 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7205cddb-0f09-49b4-9e53-f18db73f2e02 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.166784 May 10 14:02:33.702808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 83/158] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:33 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:34.328925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.329543 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.336076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.336912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.337719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.338151 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.492304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.500610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-abdc6159-d92d-44a7-9e80-431fed89359d tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1315 microversion: 2.1 time: 0.175529 May 10 14:02:34.501477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 76/159] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:34.684591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.685664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.698368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.699215 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.700353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.700920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.719704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:34.720369 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:34.727462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.728125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.729099 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:34.729695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:34.876128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.884397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b4a6014c-abaa-4723-a6bc-dc6a0193933b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.204502 May 10 14:02:34.884998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 84/160] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:34.901953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:34.909653 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-43e9c455-c56b-4a29-a06e-d22fbd464c74 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.194085 May 10 14:02:34.910254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 77/161] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:34 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:35.518861 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.519592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.526961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.526961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.527865 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.528377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.733917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:35.742471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-48af614b-e091-4d55-a349-f315dcdde979 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1502 microversion: 2.1 time: 0.227149 May 10 14:02:35.743191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 85/162] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:35.902251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.902736 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.908898 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.909689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.913532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.914948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.928694 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:35.929722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:35.937726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.938256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:35.939388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:35.940680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:36.135728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:36.144287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fbf03f72-0222-404d-8919-3ba99b6f963a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.221297 May 10 14:02:36.159081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 86/163] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:36.238553 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:36.256463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-62320e58-54f2-4968-b2ae-545b6b6476b4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.357181 May 10 14:02:36.257066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 78/164] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:35 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.161446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.162510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.168642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.169363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.170384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.171009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.203645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40a24c6e-7e42-4716-9803-c914c21c9dfa"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:37.205029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.211825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.212277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.213061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.213496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.324341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.339697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8a38ef85-dc62-4da6-8f6d-651bfe4dde89 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.181026 May 10 14:02:37.341158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 87/165] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:37.362262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:37.363894 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:37.387212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.389289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.390751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:37.392697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:37.547107 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:37.555206 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-992c16a9-f1a0-4eaa-bb6d-8f2d8fd758d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.212075 May 10 14:02:37.555783 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 88/166] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:37 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.200887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-b367dbbe-e253-4f6f-a69f-ba6b37d51e34 req-187d8f99-b5a1-40b2-b03b-538f0b0c43c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01e464c-7bb4-4da3-b486-18b941be97b9", "name": "network-vif-plugged", "status": "completed", "tag": "16a28325-933e-48f7-9d78-2defa48a5ac0"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:38.213256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-b367dbbe-e253-4f6f-a69f-ba6b37d51e34 req-187d8f99-b5a1-40b2-b03b-538f0b0c43c7 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.213707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-b367dbbe-e253-4f6f-a69f-ba6b37d51e34 req-187d8f99-b5a1-40b2-b03b-538f0b0c43c7 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.243911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-b367dbbe-e253-4f6f-a69f-ba6b37d51e34 req-187d8f99-b5a1-40b2-b03b-538f0b0c43c7 service nova] Creating event network-vif-plugged:16a28325-933e-48f7-9d78-2defa48a5ac0 for instance b01e464c-7bb4-4da3-b486-18b941be97b9 on hv-cinder-83588 May 10 14:02:38.269041 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-b367dbbe-e253-4f6f-a69f-ba6b37d51e34 req-187d8f99-b5a1-40b2-b03b-538f0b0c43c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072055 May 10 14:02:38.270980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 89/167] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:38.369243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.370756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.383831 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.386672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.387953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.389366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.530814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-57e1c1ae-7125-4925-b855-eb90375d8fa2 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "POST /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.327004 May 10 14:02:38.531988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 79/168] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:02:37 2022] POST /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:38.576511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:38.578639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:38.597075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.610473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-302e4f59-17a0-49dd-b5c7-90bd1c9eaa51 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.252953 May 10 14:02:38.611244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 90/169] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:38.616965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.618569 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.632169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:38.632169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:38.900508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:38.913503 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-84f9a840-a130-40d2-adb2-b9522926670a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.343019 May 10 14:02:38.914512 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 80/170] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:38 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.627942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.628555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.634550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.634997 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.635769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.636206 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.769136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:39.776810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-92088b12-32b1-4826-826c-746c2fa2513e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.152726 May 10 14:02:39.777409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 91/171] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:39.931201 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:39.931803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:39.939110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.939628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:39.940318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:39.940798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.076828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.085386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8ca9f53a-5472-4e1c-bb21-1322ee25560c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.159079 May 10 14:02:40.090251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 81/172] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:39 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:40.800209 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:40.800818 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:40.807228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.807669 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.808419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:40.808842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:40.935938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:40.944550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-679fa03a-2f15-4a74-bcbd-0a35ce4393f3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.147561 May 10 14:02:40.945125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 92/173] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:40 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.103134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.103751 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.110034 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.110521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.111288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.111797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.250889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:41.259891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1d88a649-b3c6-498f-80be-19a475b0cd49 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.161135 May 10 14:02:41.260455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 82/174] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:41.961083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:41.961619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:41.967543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.967982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:41.968741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:41.969174 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.097744 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.105723 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-667da99f-a8d9-4925-9a0d-f8d399b4607a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.148942 May 10 14:02:42.106315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 93/175] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:41 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:42.277091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:42.277712 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:42.284097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.284552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.285515 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:42.285955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:42.413405 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:42.420832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6dac2f26-cdc5-4b15-972a-0b85cead8577 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.147538 May 10 14:02:42.421407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 83/176] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:42 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:02:43.122980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.123618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.129544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.129993 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.131365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.131795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.253543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.261655 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cbb1dd96-8358-4287-a950-b7b98801c48f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.142390 May 10 14:02:43.262297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 94/177] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:43.437492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:43.438107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:43.444684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.445173 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.446008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:43.446577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:43.575103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:43.582233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bc097a3b-5049-4afc-a304-6cde584b032e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.148526 May 10 14:02:43.582805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 84/178] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:43 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:43.997743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-494b2a7f-4bbb-4510-b1b6-a78782a476c5 req-ff05831b-baf4-4057-938a-5df1b75058d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead53d16-350b-428b-abb0-ee729094fae0", "name": "network-vif-plugged", "status": "completed", "tag": "fec44231-1d3b-4ecc-b5bb-dddd45402204"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:44.005980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-494b2a7f-4bbb-4510-b1b6-a78782a476c5 req-ff05831b-baf4-4057-938a-5df1b75058d1 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.006452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-494b2a7f-4bbb-4510-b1b6-a78782a476c5 req-ff05831b-baf4-4057-938a-5df1b75058d1 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.017523 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-494b2a7f-4bbb-4510-b1b6-a78782a476c5 req-ff05831b-baf4-4057-938a-5df1b75058d1 service nova] Creating event network-vif-plugged:fec44231-1d3b-4ecc-b5bb-dddd45402204 for instance ead53d16-350b-428b-abb0-ee729094fae0 on hv-cinder-83588 May 10 14:02:44.022809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-494b2a7f-4bbb-4510-b1b6-a78782a476c5 req-ff05831b-baf4-4057-938a-5df1b75058d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028665 May 10 14:02:44.023395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 95/179] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:44.278360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.278854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.284862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.285329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.286070 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.286542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.421457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.427748 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4567a40e-4020-4ec0-8b83-7d96d26d6cf7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.153400 May 10 14:02:44.428321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 85/180] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:44.599790 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:44.600483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:44.606631 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.607074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.607825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:44.608260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:44.738994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:44.747106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fbec39fd-1367-4bdf-a377-10361b056e00 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.152026 May 10 14:02:44.747678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 96/181] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:44 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:45.444377 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.444922 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.451687 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.452144 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.452919 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.453393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.595498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.603586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d63218c4-76de-415e-9627-a8b152565f1c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.163344 May 10 14:02:45.604154 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 86/182] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:45.764410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:45.765180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:45.772413 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.772948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.773711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:45.774180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:45.912256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:45.919646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-abf08d61-234a-46f6-a0c1-54292dab880f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.159146 May 10 14:02:45.920208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 97/183] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:45 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:46.623901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:46.624610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:46.631757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.632214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.632992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.633435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.766304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:46.774339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-95e3b0ea-9821-4453-8ca1-537b6acf744f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.156555 May 10 14:02:46.774935 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 87/184] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:46 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:46.937103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:46.937711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:46.944363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.944802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:46.945566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:46.945991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.070629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.077872 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a397cc01-3a7e-4607-b591-64705582bdf4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.144895 May 10 14:02:47.078483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 98/185] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:46 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:47.791909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:47.792517 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:47.798958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.799519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.800348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:47.800796 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:47.929461 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:47.937216 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cd078eee-f5a1-4902-89db-6df61ae37126 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149074 May 10 14:02:47.937799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 88/186] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:47 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:48.095094 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.095706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.102088 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.102572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.103342 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.103782 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.237062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:48.245181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ec06909a-0855-43e9-8f84-f9bc7610fe2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.153939 May 10 14:02:48.245743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 99/187] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:48.954791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:48.955459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:48.962180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.962668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:48.963459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:48.963897 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.093180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.100461 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a3d05fa2-de75-46be-bfe1-99aa22c82aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149573 May 10 14:02:49.101044 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 89/188] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:48 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:49.262824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:49.263325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:49.269194 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.269636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.270423 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:49.270853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:49.400028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:49.407824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1f3c9f6f-42e1-41c6-a972-82cbd8ac5b22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.148894 May 10 14:02:49.408572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 100/189] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:49 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:50.117270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:50.117874 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:50.124258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.124708 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.125475 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.125901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.256126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:50.264837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7406ac30-9236-45ae-88ac-8ccecaea9adb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.151654 May 10 14:02:50.265676 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 90/190] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:50 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:50.424827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:50.425450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:50.432379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.432829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.433594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:50.434030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:50.742763 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:50.750043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7e0f49a2-8165-41c9-a270-fc5f062b03c7 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.329091 May 10 14:02:50.750659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 101/191] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:50 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:51.282268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:51.282894 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.290187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.290652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.291417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.291847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.417460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:51.424673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-91d3095b-120a-4065-9d0a-e0f3b4c04708 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.146159 May 10 14:02:51.425236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 91/192] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:51 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:51.767515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:51.768142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:51.775228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.775679 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.776444 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:51.776881 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:51.908448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:51.915842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ceb7503e-ebf4-4cd4-b8c5-dcfcab69ba8e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1366 microversion: 2.1 time: 0.152358 May 10 14:02:51.916398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 102/193] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:51 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:52.441496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:52.442182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:52.449224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:52.449677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:52.450473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:52.450913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:52.588976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:52.596178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-29952aee-8077-468f-9c1a-5714ba28cf16 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.158673 May 10 14:02:52.596752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 92/194] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:52 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:52.938113 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:52.938814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:52.945594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:52.946048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:52.946868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:52.947302 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.099303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.107019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-200f3c9c-1e53-4604-b338-765408f57811 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1556 microversion: 2.1 time: 0.172751 May 10 14:02:53.107885 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 103/195] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:52 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:53.124276 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:53.124774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:53.130811 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.131265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.132652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.133135 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.216168 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e1129953-955e-470d-a59e-caf7db4d8f0d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095538 May 10 14:02:53.216865 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 93/196] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:02:53 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:02:53.614091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:53.614724 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:53.621991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.622583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.623420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:53.623915 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:53.924499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:53.932277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-619ae643-9bcf-469e-a030-1bdebee40212 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.322140 May 10 14:02:53.932842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 104/197] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:53 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:54.668965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-81ea613e-66c3-4a40-93b3-37e39eac85bb req-ce229090-dc73-402c-822e-115cf1ea5c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01e464c-7bb4-4da3-b486-18b941be97b9", "tag": "16a28325-933e-48f7-9d78-2defa48a5ac0"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:02:54.677350 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-81ea613e-66c3-4a40-93b3-37e39eac85bb req-ce229090-dc73-402c-822e-115cf1ea5c84 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.677796 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-81ea613e-66c3-4a40-93b3-37e39eac85bb req-ce229090-dc73-402c-822e-115cf1ea5c84 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.689658 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-81ea613e-66c3-4a40-93b3-37e39eac85bb req-ce229090-dc73-402c-822e-115cf1ea5c84 service nova] Creating event network-changed:16a28325-933e-48f7-9d78-2defa48a5ac0 for instance b01e464c-7bb4-4da3-b486-18b941be97b9 on hv-cinder-83588 May 10 14:02:54.695600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-81ea613e-66c3-4a40-93b3-37e39eac85bb req-ce229090-dc73-402c-822e-115cf1ea5c84 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030820 May 10 14:02:54.696206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 94/198] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:02:54.950055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:54.950717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:54.957160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.957606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:54.958402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:54.958830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:55.088527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:55.095712 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bbc77497-e5dd-4970-8aa9-60fd48b04030 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149755 May 10 14:02:55.096279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 105/199] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:54 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:56.114325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:56.115369 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:56.122308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:56.122760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:56.123536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:56.123974 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:56.253948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:56.262041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e8fd30f9-abbe-4265-8d7c-5d2d1f1fc8a1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.152603 May 10 14:02:56.262650 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 95/200] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:56 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:57.278906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:57.279519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:57.285277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:57.285719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:57.286510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:57.286943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:57.413882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:57.421413 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fe0496d1-0f5b-4889-a39b-30d1bc7eeeff tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.146266 May 10 14:02:57.421962 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 106/201] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:57 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:58.438743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:58.439972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:58.447305 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.447827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.448677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:58.449183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:58.571457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:58.579343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d7fb5d8b-864d-49c1-af0f-a0944889e878 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.144449 May 10 14:02:58.579914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 96/202] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:58 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:02:59.595869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:02:59.596547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:02:59.603334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:59.603715 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:59.604480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:02:59.604921 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:02:59.733913 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:02:59.741383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2e79c5c9-d7f3-421a-bb5b-d82e634e1aa8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149429 May 10 14:02:59.742733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 107/203] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:02:59 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:00.758121 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:00.758799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:00.765194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:00.765653 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:00.766452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:00.766895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:00.900340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:00.907645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-354783a0-9578-42c8-8096-e4a59a494255 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.154123 May 10 14:03:00.908220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 97/204] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:00 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:01.924722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:01.925354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:01.931819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:01.932260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:01.933024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:01.933455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:02.057984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:02.065203 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-71988189-c14e-407b-8c36-f67aa4fdcd66 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.144374 May 10 14:03:02.065756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 108/205] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:01 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:03.082024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:03.082664 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:03.089628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:03.090084 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:03.090896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:03.091344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:03.219267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:03.227105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6f01a22b-3b8a-4b7b-a5c9-1303bfdfbe48 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149008 May 10 14:03:03.227673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 98/206] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:03 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:04.243454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:04.244063 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:04.250096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:04.250579 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:04.251340 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:04.251775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:04.380695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:04.388412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c0a627ab-b362-4bba-a5a6-5e25ed95131b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1322 microversion: 2.1 time: 0.149529 May 10 14:03:04.388986 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 109/207] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:04 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:05.407386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:05.407996 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:05.414355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.414808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:05.415576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.416009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:05.548765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:05.556542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-28f38b32-2d59-4873-8a19-48fada879ad8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1516 microversion: 2.1 time: 0.153360 May 10 14:03:05.557111 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 99/208] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:05 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:05.574000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:05.574971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:05.580771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.581214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:05.581971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.582437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:05.642107 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lazy-loading 'flavor' on Instance uuid ead53d16-350b-428b-abb0-ee729094fae0 {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:05.760289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-16c7396d-60e3-4535-9300-c87d69531d6c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0/action" status: 200 len: 32 microversion: 2.1 time: 0.190913 May 10 14:03:05.760814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 110/209] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:03:05 2022] POST /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:03:05.769692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:05.770330 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:05.776311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.776759 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:05.777520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:05.777950 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:06.172094 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:06.179952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8c73e7d5-eac5-4451-a507-f91b14a428f0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.414064 May 10 14:03:06.180533 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 100/210] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:05 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:07.198127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:07.199046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:07.213073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:07.213073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:07.213073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:07.213073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:07.379391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:07.391426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-70e1c29f-6bbc-4f7b-963a-2662d1d424ca tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.194298 May 10 14:03:07.391426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 111/211] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:07 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:08.404317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:08.404977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:08.411134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:08.411653 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:08.412412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:08.412848 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:08.547424 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:08.554818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-67e0acda-adee-47a4-bf09-e64c9dc3cc64 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.154335 May 10 14:03:08.561465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 101/212] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:08 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:09.572083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:09.572705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:09.578853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:09.579304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:09.580072 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:09.580507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:09.713277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:09.725292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9680950e-ccbf-4cf6-9fa9-8100de32f168 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.157717 May 10 14:03:09.727503 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 112/213] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:09 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:10.745096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:10.746139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:10.760717 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:10.761236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:10.761956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:10.762456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:10.927334 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:10.936669 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-da64bd88-5f99-4299-854a-0830613b71cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.197308 May 10 14:03:10.937259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 102/214] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:10 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:11.952511 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:11.953109 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:11.959672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:11.960130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:11.961100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:11.961528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:12.110241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:12.128062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b94f8011-5aeb-4c2f-8fea-8ddb7d1e5540 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.178721 May 10 14:03:12.129628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 113/215] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:11 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:13.145391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:13.146006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:13.153001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:13.153466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:13.154277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:13.154746 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:13.294538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:13.302311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8f823ca6-370e-40ce-9db7-720317cf7ded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.160630 May 10 14:03:13.302824 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 103/216] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:13 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:14.320277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:14.320836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:14.327608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:14.328051 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:14.328856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:14.329281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:14.464192 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:14.471698 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-67821a1c-f671-4f6c-9072-4bc4c5663472 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.156121 May 10 14:03:14.472265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 114/217] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:14 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:15.488784 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:15.489390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:15.496677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:15.497123 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:15.497887 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:15.498351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:15.628552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:15.635947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-51ef66b9-7e7e-42ee-878c-05f7f97be9d8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.151038 May 10 14:03:15.636511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 104/218] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:15 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:16.652239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:16.652855 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:16.658755 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:16.659199 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:16.659962 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:16.660393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:16.995062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:17.009234 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-92dbd400-c8b1-41f6-a77d-bd6e53074387 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.357120 May 10 14:03:17.009878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 115/219] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:16 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:18.026842 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:18.027466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:18.034438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:18.034438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:18.035212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:18.035918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:18.175163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:18.186804 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-15651f7c-f4d4-410b-a109-610747fb9064 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.164560 May 10 14:03:18.187402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 105/220] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:18 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:19.203317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:19.203854 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:19.209758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:19.210218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:19.210987 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:19.211930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:19.341588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:19.348835 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1cd643f0-596a-4b0c-93ff-36544c998037 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.149381 May 10 14:03:19.349399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 116/221] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:19 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:20.364434 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:20.365056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:20.371695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:20.372153 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:20.372925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:20.373366 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:20.500657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:20.507932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e6068381-8703-492b-be1a-1cdf68e6beb8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.147348 May 10 14:03:20.509124 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 106/222] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:20 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:21.304581 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:21.305345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:21.311224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.311678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.312455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.312889 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.340573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:03:21.447537 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fa8f77f3-32e1-46a9-8d41-3c6eb4ffd802 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 204 len: 0 microversion: 2.1 time: 0.146588 May 10 14:03:21.448130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 117/223] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:03:21 2022] DELETE /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:03:21.456159 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:21.456772 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:21.464445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.464901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.465896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.466513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.528133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:21.528133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:21.536191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.536658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.537788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:21.538261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:21.634220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:21.643443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6b35c66d-7e1a-476d-911f-6461e6f4df7f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1554 microversion: 2.1 time: 0.191104 May 10 14:03:21.644131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 107/224] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:21 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:21.695402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:21.703071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cb628f54-c2b1-479f-84bd-dc3557617082 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.181702 May 10 14:03:21.703833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 118/225] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:21 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:22.660590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:22.661332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:22.668722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.668930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.669783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.670373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.720538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:22.721241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:22.727993 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.729345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.730372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:22.730861 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:22.826092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:22.845512 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6e786ac4-70a8-453f-942e-f9471212e4a4 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1554 microversion: 2.1 time: 0.188604 May 10 14:03:22.846625 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 108/226] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:22 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:22.913333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:22.921711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a80cbfff-0e50-4b03-9f90-79790fd77348 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.205247 May 10 14:03:22.922313 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 119/227] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:22 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:23.864176 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:23.865491 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:23.875103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.875816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:23.877068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.877807 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:23.938725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:23.939354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:23.950125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.953158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:23.953961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:23.954438 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:24.199856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:24.221265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ab0fddf8-0aef-428b-b24a-590b01cc2d8f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.284933 May 10 14:03:24.222529 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 120/228] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:23 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:24.246389 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:24.264829 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2cf1201b-8018-467a-abf6-e646bf8e9a0c tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1554 microversion: 2.1 time: 0.403573 May 10 14:03:24.267930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 109/229] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:23 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1554 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:24.863003 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-afc808a0-440a-4e05-84c8-164fa3f9b432 req-3cb664f0-1b5e-42b4-9fcb-1272c7647d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f772bda-ce73-4ac2-aa73-28852bfa8b92", "name": "network-vif-deleted", "tag": "30a4e6db-5223-416e-8dbe-46ef6ea6be27"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:24.874327 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-afc808a0-440a-4e05-84c8-164fa3f9b432 req-3cb664f0-1b5e-42b4-9fcb-1272c7647d90 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:24.875423 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-afc808a0-440a-4e05-84c8-164fa3f9b432 req-3cb664f0-1b5e-42b4-9fcb-1272c7647d90 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:24.892291 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-afc808a0-440a-4e05-84c8-164fa3f9b432 req-3cb664f0-1b5e-42b4-9fcb-1272c7647d90 service nova] Creating event network-vif-deleted:30a4e6db-5223-416e-8dbe-46ef6ea6be27 for instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 on hv-cinder-83588 May 10 14:03:24.900623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-afc808a0-440a-4e05-84c8-164fa3f9b432 req-3cb664f0-1b5e-42b4-9fcb-1272c7647d90 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040309 May 10 14:03:24.913036 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 121/230] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:25.243460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:25.244930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:25.252164 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.252900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.253840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.254465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.284990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:25.286531 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:25.297923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.298422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.299368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.302240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.351478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:25.352727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:25.353480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lazy-loading 'fault' on Instance uuid 1f772bda-ce73-4ac2-aa73-28852bfa8b92 {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:25.422307 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f57a715b890443d78579a056f0a9ff51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db378765a65d4ed59cf60275bc325525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:25.431897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-69de853d-6132-45cc-8de1-362db23675b0 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 200 len: 1351 microversion: 2.1 time: 0.150986 May 10 14:03:25.443415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 122/231] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:25 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 1351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:25.725980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:25.737179 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a680275a-d30f-41b2-ae44-3c6ab45a720e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.501875 May 10 14:03:25.739073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 110/232] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:25 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:26.451373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:26.452526 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:26.458445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.458898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.459765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.460209 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.475402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] HTTP exception thrown: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Request method failure captured: May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 HTTP/1.1 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienA97OxpT9RRyRkAeQJC_CsZjFFSzIHzPcAcdvfRtlLc3tJacHOCvxgPU2y_Ia45AASf19jRQk-QOnHMzCxxeLTXKdud5nFZGPPoXhJyZkWBRKyTMasIc6RcryKPMGAUTIDfoTrdmd0qwzqOOR4EC7yd39GfSSg20XsUCCmzFu-s_tA May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:03:26.488474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/db378765a65d4ed59cf60275bc325525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_db378765a65d4ed59cf60275bc325525", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: f57a715b890443d78579a056f0a9ff51 May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.489824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '1f772bda-ce73-4ac2-aa73-28852bfa8b92'} May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:26.490541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.491638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:26.493525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Returning 404 to user: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:26.493525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e1a574e8-526c-46b0-be93-f4d4a6c4d841 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 404 len: 111 microversion: 2.1 time: 0.042679 May 10 14:03:26.493525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 123/233] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:26 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:03:26.603183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:26.604705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:26.615409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.616153 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.617298 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.618239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.632638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] HTTP exception thrown: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Request method failure captured: May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92/os-volume_attachments HTTP/1.1 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienA97OxpT9RRyRkAeQJC_CsZjFFSzIHzPcAcdvfRtlLc3tJacHOCvxgPU2y_Ia45AASf19jRQk-QOnHMzCxxeLTXKdud5nFZGPPoXhJyZkWBRKyTMasIc6RcryKPMGAUTIDfoTrdmd0qwzqOOR4EC7yd39GfSSg20XsUCCmzFu-s_tA May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:03:26.644008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/db378765a65d4ed59cf60275bc325525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_db378765a65d4ed59cf60275bc325525", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: f57a715b890443d78579a056f0a9ff51 May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.645232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'server_id': '1f772bda-ce73-4ac2-aa73-28852bfa8b92'} May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:26.645858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:26.646925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:26.647931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Returning 404 to user: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:26.647931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b9c9414d-94cd-4bb1-a4af-89e954984b2f tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046994 May 10 14:03:26.647931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 111/234] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:03:26 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:03:26.757368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:26.760166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:26.768655 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.769246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:26.770572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:26.771057 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.026233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:27.035247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-661d2630-9f9d-4624-8e04-b39d19b126ed tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.282773 May 10 14:03:27.035819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 124/235] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:26 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:27.898466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:27.900068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:27.907809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.908407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.909184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.909622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.925382 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] HTTP exception thrown: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Request method failure captured: May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: DELETE /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 HTTP/1.1 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienA97OxpT9RRyRkAeQJC_CsZjFFSzIHzPcAcdvfRtlLc3tJacHOCvxgPU2y_Ia45AASf19jRQk-QOnHMzCxxeLTXKdud5nFZGPPoXhJyZkWBRKyTMasIc6RcryKPMGAUTIDfoTrdmd0qwzqOOR4EC7yd39GfSSg20XsUCCmzFu-s_tA May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:03:27.927877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/db378765a65d4ed59cf60275bc325525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_db378765a65d4ed59cf60275bc325525", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: f57a715b890443d78579a056f0a9ff51 May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.929015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '1f772bda-ce73-4ac2-aa73-28852bfa8b92'} May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:27.929767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.931542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:03:27.932695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Returning 404 to user: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:27.932695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a9307ab5-5ea9-415c-9b8c-9e2c2d8bf219 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 404 len: 111 microversion: 2.1 time: 0.035248 May 10 14:03:27.932695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 112/236] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:03:27 2022] DELETE /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:03:27.941217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:27.941784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] [instance: 1f772bda-ce73-4ac2-aa73-28852bfa8b92] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:27.948911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.949373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.950153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:27.950615 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:27.964953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] HTTP exception thrown: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Request method failure captured: May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 HTTP/1.1 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienA97OxpT9RRyRkAeQJC_CsZjFFSzIHzPcAcdvfRtlLc3tJacHOCvxgPU2y_Ia45AASf19jRQk-QOnHMzCxxeLTXKdud5nFZGPPoXhJyZkWBRKyTMasIc6RcryKPMGAUTIDfoTrdmd0qwzqOOR4EC7yd39GfSSg20XsUCCmzFu-s_tA May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:03:27.966601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/db378765a65d4ed59cf60275bc325525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/db378765a65d4ed59cf60275bc325525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_db378765a65d4ed59cf60275bc325525", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: db378765a65d4ed59cf60275bc325525 May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-DeleteServersTestJSON-960281837 May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: f57a715b890443d78579a056f0a9ff51 May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-DeleteServersTestJSON-960281837-project May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.967719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '1f772bda-ce73-4ac2-aa73-28852bfa8b92'} May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:03:27.968349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. May 10 14:03:27.969377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:03:27.970327 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] Returning 404 to user: Instance 1f772bda-ce73-4ac2-aa73-28852bfa8b92 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:03:27.970327 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-43208eec-ae22-412f-b8cf-30072c6b2e35 tempest-DeleteServersTestJSON-960281837 tempest-DeleteServersTestJSON-960281837-project] 10.222.0.32 "GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92" status: 404 len: 111 microversion: 2.1 time: 0.030727 May 10 14:03:27.971924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 125/237] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:27 2022] GET /compute/v2.1/servers/1f772bda-ce73-4ac2-aa73-28852bfa8b92 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:03:28.057098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:28.057808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:28.080110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:28.080853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:28.081683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:28.086324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:28.385979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:28.398643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e27aed1c-11e8-4b33-af31-9eb44d5edccf tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.349880 May 10 14:03:28.399920 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 113/238] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:28 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:29.417976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:29.419575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:29.426250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:29.427564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:29.428674 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:29.429316 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:29.623175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:29.634479 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f7bceebe-0a20-4147-94bf-fa8dea2fe603 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.221384 May 10 14:03:29.635273 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 126/239] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:29 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:30.653573 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:30.654314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:30.661299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:30.661761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:30.662581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:30.663015 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:30.896465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:30.906274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e5db470f-99be-4201-832d-0537ace2c45a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.257743 May 10 14:03:30.909148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 114/240] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:30 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:31.927167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:31.927786 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:31.940483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:31.940984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:31.943011 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:31.945883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:32.147118 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:32.162326 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5f4bce80-f0d3-467e-a5ad-4d9a4db0ba03 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.239838 May 10 14:03:32.173828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 127/241] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:31 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:33.182375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:33.182995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:33.195016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:33.195537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:33.196971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:33.197418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:33.397630 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:33.418373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2283588b-94e0-43ae-8c92-5fa21a4059bd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.242040 May 10 14:03:33.435110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 115/242] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:33 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:34.438505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:34.440100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:34.462448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:34.464125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:34.467427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:34.468649 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:34.735622 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:34.746391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6e67d49d-dd48-419f-864a-76b7f815380e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.311870 May 10 14:03:34.746954 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 128/243] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:34 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:35.763248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:35.769069 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:35.776997 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:35.777710 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:35.778838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:35.787768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:35.919931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a8727336-aab1-4cd5-8ef3-a46e8412a58e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: .version_select at 0x7efd56461430>, body: {"keypair": {"name": "tempest-keypair-1505668752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC81ukeH1JLUMEQhrPfge+ZxZXvHrk+qgerImOIiv7QRSsemXI4rzPF/obeVc0/JeI49Q8g7sFfrBg2lNkw5v++7j2QXXeEoKQ/vnB9+LVEVe13AdimruLR5yDMNxV5u/A=="}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:35.962766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-a8727336-aab1-4cd5-8ef3-a46e8412a58e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:03:35.974561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-a8727336-aab1-4cd5-8ef3-a46e8412a58e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for user fb76fce14cf84b2bb4094fa2691777fe and project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:03:36.037428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a8727336-aab1-4cd5-8ef3-a46e8412a58e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.332750 May 10 14:03:36.038148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 116/244] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:03:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:36.163887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:36.176841 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-29886b31-295b-4724-9394-ac4285e7ba04 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.417247 May 10 14:03:36.178826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 129/245] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:35 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:37.197432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:37.198273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:37.211983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.214975 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:37.216583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:37.217195 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:37.516303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:37.530175 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-93b55438-d586-4c3c-95dd-3c2a79668cce tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.338063 May 10 14:03:37.530794 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 117/246] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:37 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:37.967182 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-432219304", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a39c3c0b-af42-4a48-a1bf-307b11e25d16"}], "security_groups": [{"name": "tempest-securitygroup--1340873549"}], "key_name": "tempest-keypair-1505668752", "user_data": "}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:38.160531 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] validate_networks() for [('a39c3c0b-af42-4a48-a1bf-307b11e25d16', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:03:38.547828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:38.548454 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:38.559831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:38.560341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:38.561063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:38.565158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:38.738394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:03:38.739132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:03:38.739764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:03:38.740489 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:03:38.741059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:03:38.757193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:38.757645 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:38.760479 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:38.763605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:38.802469 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:03:38.812606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for user fb76fce14cf84b2bb4094fa2691777fe and project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:03:38.848564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:03:38.853186 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:03:38.860879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:38.879248 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-67752404-6fe5-4ef3-bb33-d3c278c07d3d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.335265 May 10 14:03:38.880226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 118/247] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:38 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:38.973288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-65e8d3fc-491c-4a74-b0f5-75fae1127f32 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.010601 May 10 14:03:38.976558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 130/248] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:03:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:03:38.987756 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-39dcba7a-bacd-459d-8890-176e2828a236 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:38.988772 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-39dcba7a-bacd-459d-8890-176e2828a236 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:39.119922 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-39dcba7a-bacd-459d-8890-176e2828a236 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:39.131643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-39dcba7a-bacd-459d-8890-176e2828a236 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1237 microversion: 2.1 time: 0.148186 May 10 14:03:39.153403 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 119/249] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:38 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:39.900795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:39.901414 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:39.918471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:39.918471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:39.918471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:39.918471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.088046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:40.098185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-76f4e494-90ec-4279-87bc-950a8b2b2a35 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.201409 May 10 14:03:40.107165 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 131/250] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:39 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:40.157315 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:40.157941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:40.170932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.171572 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.172525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:40.173100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:40.252232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:40.260883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-adf3d809-c48c-4fe1-b247-bbdc933283f3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1289 microversion: 2.1 time: 0.108554 May 10 14:03:40.261473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 120/251] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:40 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:41.115432 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:41.117025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:41.128241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.131993 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.133540 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.136688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.279764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:41.280381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:41.287153 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.288011 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.288980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:41.289474 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:41.319639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:41.331021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3bf298f7-908f-44e6-82a5-77ccf2dba015 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.219913 May 10 14:03:41.338413 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 132/252] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:41 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:41.363609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:41.378944 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-999f3b18-a7c2-4e43-b76f-80921d014d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1295 microversion: 2.1 time: 0.102989 May 10 14:03:41.385267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 121/253] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:41 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:42.363871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:42.365057 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:42.374716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.375422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.376717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.377365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.403485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:42.404096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:42.418550 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.420346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.422304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:42.426718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:42.575567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:42.583148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ce2f33cc-d61c-4870-94cc-cab3d99e61ab tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.232420 May 10 14:03:42.584286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 133/254] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:42 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:42.716250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:42.723442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b2e4eacc-fb21-4936-93fd-ef767ef05138 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.325924 May 10 14:03:42.724020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 122/255] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:42 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:43.604117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:43.604839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:43.611299 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.611747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.612578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.613014 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.743212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:43.744894 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:43.753647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.755085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.756108 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:43.757249 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:43.780929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:43.789153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2075eb62-4ef1-4c34-8cf3-5d242938d99a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.189987 May 10 14:03:43.790758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 134/256] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:43 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:44.419391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:44.434274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3fc6ff53-5883-43e6-9db3-4e92c8ec3f6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.696319 May 10 14:03:44.446097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 123/257] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:43 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:44.808380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:44.809133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:44.827128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.828617 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:44.832650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.836107 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:44.954843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-92b776f5-642b-4c2d-b399-ec5db9b75de9 req-87959cc7-37a6-4852-bcb9-86f5fc68eca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2d918d-8df2-4251-a1e8-c73cb0c946c1", "tag": "a3267fc0-8b43-4414-a63f-84901ac8ab21"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:44.978714 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-92b776f5-642b-4c2d-b399-ec5db9b75de9 req-87959cc7-37a6-4852-bcb9-86f5fc68eca4 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:44.979161 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-92b776f5-642b-4c2d-b399-ec5db9b75de9 req-87959cc7-37a6-4852-bcb9-86f5fc68eca4 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.017491 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-92b776f5-642b-4c2d-b399-ec5db9b75de9 req-87959cc7-37a6-4852-bcb9-86f5fc68eca4 service nova] Creating event network-changed:a3267fc0-8b43-4414-a63f-84901ac8ab21 for instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 on hv-cinder-83588 May 10 14:03:45.030127 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-92b776f5-642b-4c2d-b399-ec5db9b75de9 req-87959cc7-37a6-4852-bcb9-86f5fc68eca4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082179 May 10 14:03:45.030966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 124/258] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:45.328300 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:45.340897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a666602a-b3d2-48bd-a917-71ee7ccce186 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1522 microversion: 2.1 time: 0.537934 May 10 14:03:45.347574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 135/259] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:44 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:45.466933 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:45.473035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:45.485264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.485721 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.489498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:45.489945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:45.723734 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:45.731786 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-939a8407-cd1e-4a3d-a2f5-e86d3198256d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.283288 May 10 14:03:45.742072 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 125/260] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:45 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:46.361955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.363576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.370657 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.371137 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.371929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.372377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.586878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:46.596637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4195c1e8-271b-497b-b348-4005ca31879d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1502 microversion: 2.1 time: 0.238896 May 10 14:03:46.597991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 136/261] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:46 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:46.615765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.616412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.625151 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.625683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.626977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.627628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.749540 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:46.750673 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:46.770400 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.770896 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.771729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:46.772166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:46.865838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:46.878022 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-359f873b-dca1-417e-95d9-a7b4a5bc4d07 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1514 microversion: 2.1 time: 0.265453 May 10 14:03:46.879115 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 126/262] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:46 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:47.039596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:47.054724 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8e938336-c906-4670-b212-6a3fc36d941e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.309640 May 10 14:03:47.055449 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 137/263] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:46 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:48.077628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.077628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.080427 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.080987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.081852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.082390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.224499 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:48.232821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-42d257d4-aa59-4444-ae30-86a80693aeb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.164129 May 10 14:03:48.233563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 127/264] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:48 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:48.550702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:48.552934 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.559624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.560077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.560853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.561283 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.586440 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lazy-loading 'flavor' on Instance uuid f8618c48-35fd-41ab-975f-ae42c69a6a94 {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:03:48.656716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-68f90cd5-5fa9-4095-a3db-4821f7378aa5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/action" status: 200 len: 32 microversion: 2.1 time: 0.110999 May 10 14:03:48.657339 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 138/265] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:03:48 2022] POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:03:48.666755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:48.667358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:48.673266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.673716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.674516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:48.674952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:48.801833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:48.809975 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1d7a90e6-323d-4f5b-9be8-51a75f22dfb3 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.147539 May 10 14:03:48.810580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 128/266] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:48 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:49.249759 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:49.250502 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:49.256994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.257439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.258823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.259262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.610685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:49.620336 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3b2f6df2-fb56-4093-a79e-c3556f438a26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.374757 May 10 14:03:49.621131 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 139/267] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:49 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:49.626518 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1857220711", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:49.682866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] validate_networks() for None {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:03:49.828228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:49.828845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:49.834856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.835678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:49.837885 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:49.839209 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.005382 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:03:50.006590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:03:50.007294 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:03:50.008906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:03:50.009605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:03:50.022268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.022661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:50.023266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.024992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.026014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.033548 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ab52876c-fdcf-4248-b339-ca1317031e22 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.209549 May 10 14:03:50.044314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 140/268] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:49 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:50.047963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Getting quotas for project f7151edbac0840dd801f21d540b05126. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:03:50.053726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Getting quotas for user be7c03d9578b4f0780299706f5405532 and project f7151edbac0840dd801f21d540b05126. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:03:50.079803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:03:50.082903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:03:50.149175 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e9240a11-f2ad-4813-83bc-4a4c3cceb029 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525826 May 10 14:03:50.149910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 129/269] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:03:50.160446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dd2a9149-2289-40da-a275-2568f8d9fdc6 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:50.162429 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dd2a9149-2289-40da-a275-2568f8d9fdc6 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:50.225396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dd2a9149-2289-40da-a275-2568f8d9fdc6 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:50.238777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dd2a9149-2289-40da-a275-2568f8d9fdc6 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1215 microversion: 2.1 time: 0.082390 May 10 14:03:50.241292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 141/270] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:50 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:50.637431 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:50.638061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:50.644862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.645322 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.646098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:50.646870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:50.792469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:50.801551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-557b7efb-3f98-4bfd-bd0d-8d62b86f0274 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.168511 May 10 14:03:50.813056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 130/271] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:50 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:51.051143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:51.052393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:51.060482 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.060910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.061984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.062851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.260571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:51.261513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:51.268776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.269447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.270634 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.271650 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.273737 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:51.293207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ef1edf8b-e0e5-47b4-a06f-f6c58523d807 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.245780 May 10 14:03:51.298568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 142/272] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:51 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:51.454495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:51.471882 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c1bc4278-16ac-486f-8eb5-5e4cfa88bb4a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1275 microversion: 2.1 time: 0.215978 May 10 14:03:51.472672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 131/273] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:51 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:51.821283 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:51.822284 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:51.836031 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.838479 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:51.842026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:51.842823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.040753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.058401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fadcbbd1-189d-495e-b3f6-aa358dbc73bd tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.238049 May 10 14:03:52.059776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 143/274] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:51 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:52.313559 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:52.314369 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:52.331523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.331992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.332794 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.333239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.431369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-1fdb7c01-f963-4aa4-8b1c-1063d9f23fa7 req-9232237a-c13f-4e4e-aba0-524af5627f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2d918d-8df2-4251-a1e8-c73cb0c946c1", "name": "network-vif-plugged", "status": "completed", "tag": "a3267fc0-8b43-4414-a63f-84901ac8ab21"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:52.441155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-1fdb7c01-f963-4aa4-8b1c-1063d9f23fa7 req-9232237a-c13f-4e4e-aba0-524af5627f6e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.441698 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-1fdb7c01-f963-4aa4-8b1c-1063d9f23fa7 req-9232237a-c13f-4e4e-aba0-524af5627f6e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.455059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-1fdb7c01-f963-4aa4-8b1c-1063d9f23fa7 req-9232237a-c13f-4e4e-aba0-524af5627f6e service nova] Creating event network-vif-plugged:a3267fc0-8b43-4414-a63f-84901ac8ab21 for instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 on hv-cinder-83588 May 10 14:03:52.463167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-1fdb7c01-f963-4aa4-8b1c-1063d9f23fa7 req-9232237a-c13f-4e4e-aba0-524af5627f6e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037643 May 10 14:03:52.464280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 144/275] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:52.500078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:52.500794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:52.517106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.517833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.519005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:52.519470 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:52.624062 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.645080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-69ea5668-23a5-4292-ae69-3811834b8617 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.335598 May 10 14:03:52.645707 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 132/276] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:52 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:52.796281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:52.806899 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cd2ceeb7-e65b-4b56-89b2-a2f9ec60b0d4 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.316552 May 10 14:03:52.807808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 145/277] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:52 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:53.076747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.077395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.092764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.093233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.094040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.094511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.436123 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:53.446798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c8d9e5a7-aa4b-4eef-b191-c6de590bc278 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.374780 May 10 14:03:53.449146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 133/278] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:53.662580 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.664600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.674798 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.675490 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.677018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.677457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.824400 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:53.825011 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:53.841853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.842336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.843117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.843554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.899208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:53.908877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a945cc92-3745-4050-a2de-325562554588 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.250323 May 10 14:03:53.913331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 146/279] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:53.920526 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-cc62bea9-84e8-4960-9466-a31ce6f34008 req-057d3e9b-6512-44dc-b794-3d4fdde81b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010d0ae-ba55-4615-81d5-e71b86fc0b0a", "tag": "fb0c2329-7533-4b0c-ba13-16adaebcef3e"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:53.935401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-cc62bea9-84e8-4960-9466-a31ce6f34008 req-057d3e9b-6512-44dc-b794-3d4fdde81b6b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:53.935982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-cc62bea9-84e8-4960-9466-a31ce6f34008 req-057d3e9b-6512-44dc-b794-3d4fdde81b6b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:53.949222 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-cc62bea9-84e8-4960-9466-a31ce6f34008 req-057d3e9b-6512-44dc-b794-3d4fdde81b6b service nova] Creating event network-changed:fb0c2329-7533-4b0c-ba13-16adaebcef3e for instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a on hv-cinder-83588 May 10 14:03:53.954034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-cc62bea9-84e8-4960-9466-a31ce6f34008 req-057d3e9b-6512-44dc-b794-3d4fdde81b6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037169 May 10 14:03:53.954720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 147/280] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:54.114970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:54.124994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c8434301-9a44-422f-bb55-549697f89d26 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.304693 May 10 14:03:54.126738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 134/281] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:53 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:03:54.466311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:54.467009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:54.473646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.474659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.475586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.477052 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.624873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:54.639639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c9f14776-3ce9-487e-81d3-921db7425517 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1363 microversion: 2.1 time: 0.178472 May 10 14:03:54.642368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 148/282] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:54 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:54.930429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:54.931329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:54.937699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.938152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:54.938987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:54.939390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.089632 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:55.097783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-93e7d0e1-649d-4d48-9102-f65a58f38434 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.171912 May 10 14:03:55.098611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 135/283] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:54 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:55.143002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:55.143882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:55.151245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.151696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.152467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.152901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.291665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:55.300744 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5df50911-c010-4f42-9428-160f29eecc60 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.161367 May 10 14:03:55.301532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 149/284] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:55 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:55.658339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:55.659047 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:55.665038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.665670 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.666546 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.667064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.804374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:55.813564 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4be12c46-d7e4-40dd-bf53-89ccb2967455 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1548 microversion: 2.1 time: 0.159147 May 10 14:03:55.814143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 136/285] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:55 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:55.834898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:55.834898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:55.838822 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.839410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.840271 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:55.840779 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:55.921714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b993d9f2-eddd-4fca-8d65-242729b9c603 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094174 May 10 14:03:55.922335 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 150/286] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:03:55 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:56.114821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:56.115447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:56.122143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.122629 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.123392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.123827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.255014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:56.264392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e1c3d2c2-1de2-48ee-ac56-ddd697deee72 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.153389 May 10 14:03:56.264964 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 137/287] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:56 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:56.323450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:56.324083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:56.330761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.331239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.331996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.332434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.545789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:56.553249 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-24fecb4f-f1d2-4e9f-826b-6abfad143496 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.236904 May 10 14:03:56.553825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 151/288] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:56 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:56.958361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-3fddc4f0-d5a0-43a5-87d8-a2bded9c64e8 req-528028c5-ec48-45a0-a82b-834a52510c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de2d918d-8df2-4251-a1e8-c73cb0c946c1", "tag": "a3267fc0-8b43-4414-a63f-84901ac8ab21"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:03:56.966777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-3fddc4f0-d5a0-43a5-87d8-a2bded9c64e8 req-528028c5-ec48-45a0-a82b-834a52510c77 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:56.967300 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-3fddc4f0-d5a0-43a5-87d8-a2bded9c64e8 req-528028c5-ec48-45a0-a82b-834a52510c77 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:56.978774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-3fddc4f0-d5a0-43a5-87d8-a2bded9c64e8 req-528028c5-ec48-45a0-a82b-834a52510c77 service nova] Creating event network-changed:a3267fc0-8b43-4414-a63f-84901ac8ab21 for instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 on hv-cinder-83588 May 10 14:03:56.983946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-3fddc4f0-d5a0-43a5-87d8-a2bded9c64e8 req-528028c5-ec48-45a0-a82b-834a52510c77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029230 May 10 14:03:56.984622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 138/289] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:03:57.282147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:57.282784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:57.288512 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.289740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.290551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.290988 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.421595 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:57.428949 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-25c5d2db-2445-4cb4-a528-e783b2493311 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.150682 May 10 14:03:57.429562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 152/290] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:57 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:57.571957 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:57.572783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:57.578943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.579468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.580246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:57.580685 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:57.726040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:57.734940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c84e63fe-bcdb-4374-8af4-025a4b179ccf tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.168217 May 10 14:03:57.735531 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 139/291] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:57 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:58.446344 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:58.447132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.453030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.453485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.454352 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.454791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.591159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:58.598672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9a9b6320-09b4-4ae7-8157-439718bbb03b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.156420 May 10 14:03:58.599247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 153/292] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:58 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:58.752703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:58.753346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:58.760032 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.760488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:58.761263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:58.761701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.053342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:59.060847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-02f67748-04b4-4f4c-ab81-e66212b97c22 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.311917 May 10 14:03:59.061430 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 140/293] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:58 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:03:59.615771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:03:59.616568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:03:59.623578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.624036 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.624841 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:03:59.625280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:03:59.766437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:03:59.775858 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-47513507-7ce1-4f13-a9a0-bcbe5cf227cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.163082 May 10 14:03:59.776695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 154/294] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:03:59 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:00.078255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:00.078877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:00.085449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.086858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.087760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.088224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.230191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:00.237542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3d3a6607-7e35-4475-b2d5-b2ba9be3f8bb tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.163493 May 10 14:04:00.238226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 141/295] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:00 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:00.794291 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:00.794738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:00.800437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.801000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.803629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:00.809641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:00.978321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:00.991823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4ede2d56-c40b-46ad-92d4-cc23e6aacc2e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.202731 May 10 14:04:00.993409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 155/296] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:00 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:01.255554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:01.256183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:01.263466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.263953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.264789 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:01.265232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:01.400104 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:01.407394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dbf3a254-2835-49a7-83d9-232aa8f2e4e9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.155746 May 10 14:04:01.408071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 142/297] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:01 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:02.009632 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:02.010239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:02.016147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.016680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.017340 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.017770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.158119 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:02.166726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-83691a35-9597-4173-bfee-a67cb4a4ddbb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.161495 May 10 14:04:02.168026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 156/298] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:02 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:02.426390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:02.427007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:02.433655 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.434612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.435959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:02.436647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:02.573756 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:02.583571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6c6bb9f8-c36d-4f2d-941b-5f2f4f9d982e tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.162445 May 10 14:04:02.584284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 143/299] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:02 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:03.185231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:03.186636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:03.194139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.194664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.195933 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.196456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.368966 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:03.376826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0b9b7759-68d3-44bd-8093-628047a3216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.196013 May 10 14:04:03.386770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 157/300] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:03 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:03.600989 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:03.602568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:03.609699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.610227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.610997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:03.611625 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:03.897641 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:03.907615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5dd82ca9-d419-4f53-be5f-cba8dae00f5b tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.310432 May 10 14:04:03.909252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 144/301] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:03 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:04.394301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:04.394911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:04.402904 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.403556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.404504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.405250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.573955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:04.581439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b401ce7b-ea9a-40fa-9683-d76aa6c99b20 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.191334 May 10 14:04:04.582241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 158/302] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:04 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:04.926081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:04.926959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:04.944276 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.944870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:04.946543 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:04.947028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.146637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:05.157060 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-98a5fe43-5ece-4c15-93d9-1323ae19b934 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.233821 May 10 14:04:05.158324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 145/303] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:04 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:05.598752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:05.599476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:05.605516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.605973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.606803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:05.607240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:05.741246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:05.750505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fc35a3db-a3cf-47f1-b57e-c19ad4f4040f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.155450 May 10 14:04:05.751386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 159/304] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:05 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:06.175601 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:06.176813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:06.185684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.186150 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.186979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.187420 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.325682 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:06.331392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-e6c2bacb-a198-41c9-b6ec-8dbe78cc1883 req-4edd5adf-2b05-4a78-8a94-9469fca3a4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010d0ae-ba55-4615-81d5-e71b86fc0b0a", "name": "network-vif-plugged", "status": "completed", "tag": "fb0c2329-7533-4b0c-ba13-16adaebcef3e"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:06.344038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e6c2bacb-a198-41c9-b6ec-8dbe78cc1883 req-4edd5adf-2b05-4a78-8a94-9469fca3a4d0 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.345480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e6c2bacb-a198-41c9-b6ec-8dbe78cc1883 req-4edd5adf-2b05-4a78-8a94-9469fca3a4d0 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.346845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8bd6a652-cfd1-45f4-b627-0c29afa709dd tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.175872 May 10 14:04:06.347629 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 146/305] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:06 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:06.368555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-e6c2bacb-a198-41c9-b6ec-8dbe78cc1883 req-4edd5adf-2b05-4a78-8a94-9469fca3a4d0 service nova] Creating event network-vif-plugged:fb0c2329-7533-4b0c-ba13-16adaebcef3e for instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a on hv-cinder-83588 May 10 14:04:06.375965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-e6c2bacb-a198-41c9-b6ec-8dbe78cc1883 req-4edd5adf-2b05-4a78-8a94-9469fca3a4d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048252 May 10 14:04:06.376799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 160/306] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:04:06.768678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:06.769287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:06.776508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.776956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.777722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.778162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.916148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:06.923852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-acf71f74-8ca9-4d02-90ea-1c87806b9bdc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1500 microversion: 2.1 time: 0.159054 May 10 14:04:06.924457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 147/307] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:06 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1500 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:06.942485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e5a91e-29d9-4fb2-93c2-4749f4ca5114"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:06.944518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:06.956588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.957600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.958460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:06.959089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:06.987362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] HTTP exception thrown: Cannot 'attach_volume' instance f8618c48-35fd-41ab-975f-ae42c69a6a94 while it is in vm_state rescued May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Request method failure captured: May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/os-volume_attachments HTTP/1.1 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 74 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIg0Kt1vEsK0v55lcfihVciib-NJkhVshJVV6NMx8ilUp4B4YfQ3KwbQUxwb-DsrIzWDBZfjdva7wvnq74azHqHwO7Ri-IZ5oENA7fNKssFN6ySubXbUIuPp1B1jOfDl4oUWR3pF8q59CWKnAQsV2rlXWNx0sT495AlBPjNysBm2g May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:04:06.989364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_523029c9401f49c399be46bfe308b5e6", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1897b88622664ceca4deac5a22079726 May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {"volumeAttachment": {"volumeId": "67e5a91e-29d9-4fb2-93c2-4749f4ca5114"}} May 10 14:04:06.990897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Cannot 'attach_volume' instance f8618c48-35fd-41ab-975f-ae42c69a6a94 while it is in vm_state rescued May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'server_id': 'f8618c48-35fd-41ab-975f-ae42c69a6a94', 'body': {'volumeAttachment': {'volumeId': '67e5a91e-29d9-4fb2-93c2-4749f4ca5114'}}} May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:06.992292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f8618c48-35fd-41ab-975f-ae42c69a6a94 while it is in vm_state rescued May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:06.994500 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f8618c48-35fd-41ab-975f-ae42c69a6a94 while it is in vm_state rescued May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Returning 409 to user: Cannot 'attach_volume' instance f8618c48-35fd-41ab-975f-ae42c69a6a94 while it is in vm_state rescued {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:06.995859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2d2edc5e-949f-4906-bc6c-d29dc0831dd5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052699 May 10 14:04:06.996298 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 161/308] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:04:06 2022] POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 14:04:07.000709 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:07.001246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:07.007363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.008673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.009451 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.009894 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.080963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-84c4c548-a26a-4231-bea5-d6e2a1d073c4 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/action" status: 202 len: 0 microversion: 2.1 time: 0.083818 May 10 14:04:07.084661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 148/309] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:04:06 2022] POST /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:04:07.090163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:07.090923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:07.097177 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.097764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.098840 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.099572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.316850 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:07.326971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0fc023af-7734-42cd-8927-3600f67b5a6f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1508 microversion: 2.1 time: 0.240757 May 10 14:04:07.327695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 162/310] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:07 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:07.365938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:07.366677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:07.374038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.374539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.375325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:07.375768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:07.524132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:07.534250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5c958d61-d1b5-4e4e-84eb-9396284759c9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.172738 May 10 14:04:07.536943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 149/311] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:07 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:08.345405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:08.346546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:08.356141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.356141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.356141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.356141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.509259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:08.516688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5e49c564-3364-44a8-b0c7-c732fbbe92de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1508 microversion: 2.1 time: 0.175617 May 10 14:04:08.517265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 163/312] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:08 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:08.552847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:08.553452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:08.560363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.560810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.561575 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:08.562006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:08.783915 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:08.792616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2ba79737-4622-4152-b8d0-b96ab69d7153 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1315 microversion: 2.1 time: 0.243471 May 10 14:04:08.793204 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 150/313] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:08 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:09.534838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:09.536361 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:09.545023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.546340 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.547777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.548539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.761092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:09.770043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-840fe1d3-7b9e-42cf-8578-4cef6cadeebb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1508 microversion: 2.1 time: 0.240674 May 10 14:04:09.770648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 164/314] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:09 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:09.810124 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:09.811488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:09.818456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.819418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:09.821645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:09.822797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.071796 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:10.079337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-53d04af5-a0ea-4a8f-a163-cf7e5393bb65 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1464 microversion: 2.1 time: 0.273177 May 10 14:04:10.079912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 151/315] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:09 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1464 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:10.124094 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.124493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.130756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.131207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.131979 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.132565 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.167476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:04:10.272124 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-463d7d82-f42c-4668-8008-f99ef872c277 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 204 len: 0 microversion: 2.1 time: 0.152161 May 10 14:04:10.272706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 165/316] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:04:10 2022] DELETE /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:04:10.281329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.283158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.291416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.292025 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.292993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.293502 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.445865 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:10.456667 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-964e9d37-d15c-4c50-8782-aac0b8da2437 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1470 microversion: 2.1 time: 0.179438 May 10 14:04:10.457474 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 152/317] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:10 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:10.787727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:10.788432 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:10.795457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.795914 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.797329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:10.797953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:10.993501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:11.039307 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2f3bf955-82ab-4418-9e3f-fb52c96d734d tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1508 microversion: 2.1 time: 0.237578 May 10 14:04:11.039307 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 166/318] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:10 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:11.475012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:11.475519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:11.489700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.490969 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.494348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:11.495049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:11.748959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:11.758360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0195c564-62b9-4de3-aa72-59b6ed20629a tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1470 microversion: 2.1 time: 0.286701 May 10 14:04:11.765170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 153/319] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:11 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:12.050584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:12.051349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:12.068263 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.069027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.070592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.071257 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.318701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.330117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9a89e80a-bbf8-4346-b230-4710cb7b0720 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1508 microversion: 2.1 time: 0.283944 May 10 14:04:12.340515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 167/320] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:12 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:12.776459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:12.780240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:12.789854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.790887 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.791728 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:12.792173 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:12.971301 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:12.979821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-db48ae0d-eedc-44d6-98db-a25f09b2f6a9 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1470 microversion: 2.1 time: 0.207608 May 10 14:04:12.980655 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 154/321] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:12 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:13.350408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:13.352491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:13.360672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.361516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.362587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.363353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.690878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:13.701583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-75706b4b-a207-4ac2-8776-04e79dfbaded tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1514 microversion: 2.1 time: 0.357178 May 10 14:04:13.708707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 168/322] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:13 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1514 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:13.854953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-15cdcbfd-b25a-4e7b-849b-434546d6fb87 req-b2130476-f53a-42bd-879e-45262539dd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010d0ae-ba55-4615-81d5-e71b86fc0b0a", "name": "network-vif-deleted", "tag": "fb0c2329-7533-4b0c-ba13-16adaebcef3e"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:13.881107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-15cdcbfd-b25a-4e7b-849b-434546d6fb87 req-b2130476-f53a-42bd-879e-45262539dd58 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:13.881938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-15cdcbfd-b25a-4e7b-849b-434546d6fb87 req-b2130476-f53a-42bd-879e-45262539dd58 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:13.908595 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-15cdcbfd-b25a-4e7b-849b-434546d6fb87 req-b2130476-f53a-42bd-879e-45262539dd58 service nova] Creating event network-vif-deleted:fb0c2329-7533-4b0c-ba13-16adaebcef3e for instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a on hv-cinder-83588 May 10 14:04:13.924778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-15cdcbfd-b25a-4e7b-849b-434546d6fb87 req-b2130476-f53a-42bd-879e-45262539dd58 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072725 May 10 14:04:13.925598 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 155/323] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:13.999026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:14.000000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:14.013746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.024642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.033190 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.033575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.074175 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1557314931", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "networks": [{"uuid": "18b7924d-bd77-4212-b305-deb3c5f8e9f4"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:14.151867 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.152327 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.152789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lazy-loading 'fault' on Instance uuid 4010d0ae-ba55-4615-81d5-e71b86fc0b0a {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:04:14.201838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] validate_networks() for [('18b7924d-bd77-4212-b305-deb3c5f8e9f4', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:04:14.287169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7c03d9578b4f0780299706f5405532', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7151edbac0840dd801f21d540b05126', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:14.304564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b4018c35-d76f-4631-bd8b-081cf4cec210 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 200 len: 1305 microversion: 2.1 time: 0.309575 May 10 14:04:14.314635 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 169/324] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:13 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 1305 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:14.788336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:04:14.789241 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:04:14.790574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:04:14.791343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:04:14.791952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:04:14.801096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.801790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.802651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:14.803122 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:14.824642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Getting quotas for project 0305a36033ca4831b0bcba8a9b3c5a27. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:14.829861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Getting quotas for user acdd7d7f383f4399ae863e65b10c4586 and project 0305a36033ca4831b0bcba8a9b3c5a27. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:14.861610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:04:14.866179 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:04:14.950359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f9641d71-cbf3-492f-942c-159fa0e69790 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880404 May 10 14:04:14.951295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 156/325] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:04:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:04:14.964965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-da3734ad-afd5-4c20-86c7-69ff9cadf842 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:14.965501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-da3734ad-afd5-4c20-86c7-69ff9cadf842 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:15.141808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-da3734ad-afd5-4c20-86c7-69ff9cadf842 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:15.162164 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-da3734ad-afd5-4c20-86c7-69ff9cadf842 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1219 microversion: 2.1 time: 0.204204 May 10 14:04:15.175909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 170/326] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:14 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1219 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:15.322551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:15.323226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] [instance: 4010d0ae-ba55-4615-81d5-e71b86fc0b0a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:15.336364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.336926 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.337724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:15.338167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:15.355691 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] HTTP exception thrown: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Request method failure captured: May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a HTTP/1.1 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienDEcaCFPFiSr2QgcshOt5BgdTqVym1i8CQbXjS6jYoRRb23GUJM_b6Y0MdE2DlciHanHB8XYJaAnDHs0JakVAGBwSwFGPhzYkjBH8KGVOhKvAmP5uhvuFqg6KIGrHMFxrw3aq_VKd4R5iNvHhdR_TeGKSo1rGfVz2vh9-lG7oPKdq0 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: f7151edbac0840dd801f21d540b05126 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesNegativeTest-1477071706 May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:04:15.362091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/f7151edbac0840dd801f21d540b05126"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/f7151edbac0840dd801f21d540b05126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/f7151edbac0840dd801f21d540b05126"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_f7151edbac0840dd801f21d540b05126", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesNegativeTest-1477071706 May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: f7151edbac0840dd801f21d540b05126 May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesNegativeTest-1477071706 May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesNegativeTest-1477071706-project May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: be7c03d9578b4f0780299706f5405532 May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesNegativeTest-1477071706-project May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. May 10 14:04:15.363583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '4010d0ae-ba55-4615-81d5-e71b86fc0b0a'} May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:04:15.364526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. May 10 14:04:15.365896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:04:15.367886 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] Returning 404 to user: Instance 4010d0ae-ba55-4615-81d5-e71b86fc0b0a could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:04:15.369177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-84757409-d75e-4391-902a-fc9b5a819c01 tempest-VolumesNegativeTest-1477071706 tempest-VolumesNegativeTest-1477071706-project] 10.222.0.32 "GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a" status: 404 len: 111 microversion: 2.1 time: 0.051732 May 10 14:04:15.370217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 157/327] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:15 2022] GET /compute/v2.1/servers/4010d0ae-ba55-4615-81d5-e71b86fc0b0a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:04:15.577613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-00afce5c-8a15-4851-8a04-91f6ece530d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: .version_select at 0x7efd56c22550>, body: {"keypair": {"name": "tempest-keypair-1228130064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHlBfsw9n8lIBbCnkSrUDkturoSrLRGTf7/4a9Mqt1eULzXQ9FQ5t/im2prH/LnWs3l/n2YTb5hZk+m/weA6AzPr1EsGH7xL76qC+0EQAaUi1DewpZZQuDXI4g6bZeWbg=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:15.631265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-00afce5c-8a15-4851-8a04-91f6ece530d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for project 523029c9401f49c399be46bfe308b5e6. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:15.637521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-00afce5c-8a15-4851-8a04-91f6ece530d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for user 1897b88622664ceca4deac5a22079726 and project 523029c9401f49c399be46bfe308b5e6. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:15.707456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-00afce5c-8a15-4851-8a04-91f6ece530d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134547 May 10 14:04:15.708022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 171/328] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:04:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:16.184565 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:16.187765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:16.204173 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:16.206357 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:16.207422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:16.208829 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:16.364970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:16.376716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-54e7a65c-f81a-465f-94d0-4b15aece2f0f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1271 microversion: 2.1 time: 0.197092 May 10 14:04:16.377575 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 158/329] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:16 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:17.394578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:17.395219 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:17.404226 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:17.407046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:17.409092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:17.409774 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:17.506006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:17.518699 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0fa28c4b-cd43-4ed8-be9f-c976c1cf45be tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1277 microversion: 2.1 time: 0.128234 May 10 14:04:17.520330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 172/330] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:17 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:18.537039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:18.537958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:18.569111 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.571842 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.573013 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:18.574924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:18.992770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:19.001116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b449011f-a196-4d97-a2ef-d42473926b67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.468444 May 10 14:04:19.008300 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 159/331] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:18 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:19.277347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1899509883", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c48a28d6-d3fb-47b6-bcca-bb27d9f57474"}], "security_groups": [{"name": "tempest-securitygroup--1880299954"}], "key_name": "tempest-keypair-1228130064", "user_data": "}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:19.481339 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] validate_networks() for [('c48a28d6-d3fb-47b6-bcca-bb27d9f57474', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:04:19.561567 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-db4b6181-009b-40f0-b16e-a7a95ca160d5 req-0154ae1f-2bc0-4457-bb7a-9c66b00ece8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc8a7c1-1aa5-45f6-acc9-8443931fe72b", "tag": "95692f19-6cbf-48e7-a04c-e51b4b06d49a"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:19.581917 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-db4b6181-009b-40f0-b16e-a7a95ca160d5 req-0154ae1f-2bc0-4457-bb7a-9c66b00ece8b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:19.582428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-db4b6181-009b-40f0-b16e-a7a95ca160d5 req-0154ae1f-2bc0-4457-bb7a-9c66b00ece8b service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:19.612678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-db4b6181-009b-40f0-b16e-a7a95ca160d5 req-0154ae1f-2bc0-4457-bb7a-9c66b00ece8b service nova] Creating event network-changed:95692f19-6cbf-48e7-a04c-e51b4b06d49a for instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b on hv-cinder-83588 May 10 14:04:19.625470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-db4b6181-009b-40f0-b16e-a7a95ca160d5 req-0154ae1f-2bc0-4457-bb7a-9c66b00ece8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067786 May 10 14:04:19.628441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 160/332] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:20.029764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:20.031130 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:20.047260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.071563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.072905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.073583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.380254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:20.396071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-98201491-7b17-4b30-8b76-dcecb761595d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.370435 May 10 14:04:20.402533 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 161/333] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:20 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:20.766570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:04:20.767741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:04:20.772609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:04:20.773366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:04:20.774093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:04:20.785125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.785714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.786559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:20.787000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:20.808137 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:20.817582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Getting quotas for user 1897b88622664ceca4deac5a22079726 and project 523029c9401f49c399be46bfe308b5e6. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:20.833175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:04:20.837582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:04:20.892927 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6de22b1e-9f29-4169-8421-f6fed20688de tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.623502 May 10 14:04:20.893593 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 173/334] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:04:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 1625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:04:20.918802 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-03f2c08c-e356-480d-8e66-a5b42e90b522 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:20.920970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-03f2c08c-e356-480d-8e66-a5b42e90b522 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:20.993955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-03f2c08c-e356-480d-8e66-a5b42e90b522 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.001838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-03f2c08c-e356-480d-8e66-a5b42e90b522 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1246 microversion: 2.1 time: 0.099166 May 10 14:04:21.002467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 162/335] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:20 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:21.409646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:21.410612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:21.417944 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.418604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.419412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:21.419860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:21.605658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:21.614059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-43d81194-b674-4fa7-941a-9a5529e0f8d5 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.208467 May 10 14:04:21.615037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 174/336] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:21 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:22.020412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:22.021941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:22.030043 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.035193 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.036316 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.036760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.127586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.138729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a32ebd54-117e-4e37-9b86-dc115ed8d01c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1250 microversion: 2.1 time: 0.122887 May 10 14:04:22.139966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 163/337] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:22 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1250 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:22.632600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:22.633265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:22.644539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.646552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.647364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:22.649208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:22.861753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:22.876133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6b5020fc-ae87-4ac1-b304-2569baf9cb7d tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.247535 May 10 14:04:22.877861 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 175/338] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:22 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:23.156262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:23.156935 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:23.163274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.164812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.166103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.167006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.242555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:23.250969 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3287a4fc-6ebe-4104-a1c7-2799954db614 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1298 microversion: 2.1 time: 0.098436 May 10 14:04:23.251550 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 164/339] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:23 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:23.894565 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:23.895198 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:23.901892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.902636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:23.903577 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:23.904173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:24.144347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:24.153560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a0a511ef-5d19-4cbb-a889-64dc729face7 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.262912 May 10 14:04:24.163465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 176/340] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:23 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:24.271525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:24.272391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:24.287590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:24.288128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:24.289210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:24.291423 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:24.481644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:24.493929 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-10751046-3a20-44d6-aa05-8e727e19e639 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1304 microversion: 2.1 time: 0.227652 May 10 14:04:24.495308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 165/341] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:24 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:25.017849 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3bce9048-e2e7-4a26-9a40-9a273211c0d9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Action: 'create', calling method: .version_select at 0x7efd56c894c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-91343943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEuqunzj79mTZ09Og+mW8ux2C9IWAMQnQRe8j6/L4Mnstt6aXGeGjGTrtqRxhZnjbqDC4Yh8GQKF58pGg/OK5lmBsz6JVDa+mO844w8K8yc8a1al73kJwUcHilEmRYMug=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:25.033938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-3bce9048-e2e7-4a26-9a40-9a273211c0d9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Getting quotas for project a9cb94e930984858b30744fc14ca334e. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:25.037928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-3bce9048-e2e7-4a26-9a40-9a273211c0d9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Getting quotas for user 56462e4305424b099473d1e42adab9a9 and project a9cb94e930984858b30744fc14ca334e. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:25.064443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3bce9048-e2e7-4a26-9a40-9a273211c0d9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.244243 May 10 14:04:25.065213 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 177/342] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:04:24 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:25.189170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:25.190114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:25.203053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:25.203549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.204354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:25.204791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.513269 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:25.514351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:25.522158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:25.524328 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.525522 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:25.527478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:25.608508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:25.618591 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-37f54da0-9a86-4454-98fc-bd4c398d9c10 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.450561 May 10 14:04:25.629970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 166/343] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:25 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:25.717675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:25.725893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-de2db379-495d-4639-b9dd-e2db3aeee770 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.216954 May 10 14:04:25.727509 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 178/344] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:25 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:26.091520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-34ad5c47-68f8-4d00-8a95-11cc471587a2 req-9be9048b-a65a-464e-8d2e-5d877f1ad6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:26.102325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-34ad5c47-68f8-4d00-8a95-11cc471587a2 req-9be9048b-a65a-464e-8d2e-5d877f1ad6cb service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.103098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-34ad5c47-68f8-4d00-8a95-11cc471587a2 req-9be9048b-a65a-464e-8d2e-5d877f1ad6cb service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.117596 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-34ad5c47-68f8-4d00-8a95-11cc471587a2 req-9be9048b-a65a-464e-8d2e-5d877f1ad6cb service nova] Creating event network-changed:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:04:26.129360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-34ad5c47-68f8-4d00-8a95-11cc471587a2 req-9be9048b-a65a-464e-8d2e-5d877f1ad6cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041961 May 10 14:04:26.135839 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 167/345] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:26.636496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:26.637185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:26.650967 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.651426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.652197 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.652634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.744971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:26.745680 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:26.754549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.757239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.760479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:26.761256 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:26.830032 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:26.843928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-46e636e2-67f6-4895-b8e9-e4d44b566523 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.212174 May 10 14:04:26.858235 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 179/346] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:26 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:26.955944 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:26.965282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-949b703a-dde3-4082-b70b-f4c5f890df7c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.225757 May 10 14:04:26.966018 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 168/347] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:26 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:27.865135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:27.865746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:27.874903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.875667 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:27.876853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.877184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:27.982506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:27.983171 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:27.994476 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.994934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:27.995729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:27.996165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:28.058695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:28.066383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-30aa5c21-f2de-4664-9743-5f46526133c8 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.204996 May 10 14:04:28.067085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 180/348] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:27 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:28.160775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:28.169187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ccc60022-9c30-4fb7-aa9f-949ab5d9d851 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.190490 May 10 14:04:28.170004 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 169/349] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:27 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:29.083697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:29.084343 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:29.091438 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.091895 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.092672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.093114 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.185892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:29.186541 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:29.192882 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.193338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.194106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.195076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.219467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:29.227128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a83e290e-7ca4-4887-8cc4-acbe626e935f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.147121 May 10 14:04:29.227701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 181/350] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:29 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:29.334105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:29.342146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f853a66f-d559-47e5-98e6-744fa082a4d0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.159983 May 10 14:04:29.342753 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 170/351] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:29 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:29.666492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-748b2585-2e4f-420f-bc3f-4f0a2bb3bbcc req-3288c0b2-1961-454d-bcd7-d0b9f374e1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8a7c1-1aa5-45f6-acc9-8443931fe72b", "name": "network-vif-plugged", "status": "completed", "tag": "95692f19-6cbf-48e7-a04c-e51b4b06d49a"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:29.680592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-748b2585-2e4f-420f-bc3f-4f0a2bb3bbcc req-3288c0b2-1961-454d-bcd7-d0b9f374e1b6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:29.683457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-748b2585-2e4f-420f-bc3f-4f0a2bb3bbcc req-3288c0b2-1961-454d-bcd7-d0b9f374e1b6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:29.699014 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-748b2585-2e4f-420f-bc3f-4f0a2bb3bbcc req-3288c0b2-1961-454d-bcd7-d0b9f374e1b6 service nova] Creating event network-vif-plugged:95692f19-6cbf-48e7-a04c-e51b4b06d49a for instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b on hv-cinder-83588 May 10 14:04:29.711860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-748b2585-2e4f-420f-bc3f-4f0a2bb3bbcc req-3288c0b2-1961-454d-bcd7-d0b9f374e1b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048998 May 10 14:04:29.712623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 182/352] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:30.245355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:30.245964 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:30.252285 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.252737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.253497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.253935 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.359314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:30.360017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:30.366102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.367110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.367886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:30.368588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:30.399623 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:30.407069 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3a62a75f-ce9a-4804-82ef-3c19964bb021 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.166693 May 10 14:04:30.418509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 171/353] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:30 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:30.501403 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:30.509771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f2b3a457-f92a-4818-9b69-fd4a53e95f5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.154706 May 10 14:04:30.510382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 183/354] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:30 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:31.424749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:31.425358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:31.432604 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.433051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:31.433876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.434344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:31.527449 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:31.528159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:31.534142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.534634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:31.535409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:31.535851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:31.565145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:31.573131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9a537271-65a1-4773-841b-5097cac8da8f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.152217 May 10 14:04:31.573712 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 172/355] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:31 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:31.668977 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:31.676930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e9db033b-46eb-451e-84c1-1a4cfaf25ab7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.154217 May 10 14:04:31.677495 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 184/356] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:31 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:32.590852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:32.591458 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:32.597787 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:32.598260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:32.599020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:32.599453 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:32.694644 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:32.695536 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:32.701435 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:32.701954 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:32.702929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:32.703388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:32.729077 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:32.736502 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-32eac4c7-b106-4927-8c73-6b7385e7c984 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.149486 May 10 14:04:32.737079 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 173/357] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:32 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:32.831075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:32.839675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5529e5c5-1652-49a6-a96b-7decba4f9762 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.149389 May 10 14:04:32.840244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 185/358] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:32 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:33.753030 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:33.753664 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:33.760314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.760767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.761537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.761976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.856687 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:33.857600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:33.863656 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.864178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.865025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:33.865538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:33.893121 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:33.901090 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-fe725ec7-d3a7-4177-9289-32aef4646073 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.151979 May 10 14:04:33.901678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 174/359] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:33 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:33.997576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:34.004777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-18341343-c01b-4c66-8e93-03d2deaef9b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.152000 May 10 14:04:34.005336 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 186/360] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:33 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:34.917695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:34.918338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:34.924738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:34.925203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:34.925952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:34.926423 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:35.020652 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:35.021297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:35.027626 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:35.028005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:35.028773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:35.029203 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:35.057755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:35.065282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f17d54c3-7733-4c3b-b62b-77619b0d629a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.151386 May 10 14:04:35.065943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 175/361] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:34 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:35.155066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:35.162334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-52aa478a-c9c2-4937-b370-7054de1a827f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.145450 May 10 14:04:35.162901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 187/362] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:35 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:36.081092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:36.081622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:36.089247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:36.089700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:36.090497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:36.090937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:36.179609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:36.180227 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:36.186347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:36.186792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:36.187556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:36.187985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:36.231535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:36.238732 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6022213a-fcf9-482d-be5b-15bf14d4c143 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.161543 May 10 14:04:36.239300 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 176/363] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:36 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:36.320209 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:36.327536 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7c67ab3c-d616-4ff7-a3ef-02598b0d692b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.151768 May 10 14:04:36.328100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 188/364] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:36 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:37.255775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:37.256387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:37.263145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:37.263599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:37.264370 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:37.264806 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:37.344868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:37.345487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:37.351543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:37.351995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:37.353271 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:37.353712 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:37.392443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:37.400026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-95a80c32-46f4-4368-8616-d2128c370584 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.148061 May 10 14:04:37.400618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 177/365] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:37 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:37.479877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:37.487344 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-885a2b89-6fa4-431e-b2ee-1813002e38fa tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.146355 May 10 14:04:37.487918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 189/366] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:37 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:38.417847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:38.418939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:38.427036 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:38.427492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:38.428279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:38.428719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:38.508515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:38.510229 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:38.520236 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:38.520702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:38.521491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:38.521933 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:38.583648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:38.591447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dafc3f14-5f79-4301-9f00-b69379019e5b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.178482 May 10 14:04:38.592740 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 178/367] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:38 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:38.659187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:38.667399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-569b990b-e1b2-4965-b339-52713007ac6a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.166115 May 10 14:04:38.668038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 190/368] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:38 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:39.609049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:39.609663 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:39.616053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.616508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.617279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.617716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.684127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:39.684741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:39.690789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.691238 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.692025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:39.692462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:39.752584 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:39.760815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ba9d0da2-bd7f-422b-8b8f-addf6bee4c24 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.155569 May 10 14:04:39.761909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 179/369] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:39 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:39.828322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:39.835761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d54cff0a-68ea-48b6-8447-8a6cc2cbd227 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.155480 May 10 14:04:39.836361 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 191/370] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:39 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:40.778718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:40.779356 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:40.785799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.786273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.787038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.787470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.853885 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:40.854900 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:40.861092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.861541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.862341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:40.862778 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:40.917855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:40.925331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-749f7be1-36ef-4430-92ce-2729208e5749 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.151011 May 10 14:04:40.925928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 180/371] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:40 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:40.989982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:40.997806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c1ca17fa-a225-4a2d-8d43-8f4524198c0f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.148824 May 10 14:04:40.998402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 192/372] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:40 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:41.941913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:41.942559 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:41.949884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.950374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:41.951159 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:41.951603 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:42.014864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:42.015455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:42.021265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:42.021714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:42.022499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:42.023039 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:42.081904 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:42.089768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0e289441-ffd3-4a03-8826-8e45b79df220 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.151706 May 10 14:04:42.090556 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 181/373] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:41 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:42.152105 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:42.159980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a33ae9ff-1a78-4748-898d-792e654411d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.148921 May 10 14:04:42.160578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 193/374] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:42 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:43.107143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:43.107754 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:43.114133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.114584 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.115344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.115775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.176741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:43.177426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:43.183586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.184043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.184836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:43.185276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:43.244534 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:43.251823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3b3a179e-5de6-4af0-9443-b200ea178ba1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.149240 May 10 14:04:43.252412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 182/375] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:43 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:43.312546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:43.320020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fe5d971e-dc04-49ef-8993-985d48d057d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.147210 May 10 14:04:43.320620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 194/376] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:43 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:44.268675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.269289 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.276442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.276891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.277660 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.278096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.337454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:44.338420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:44.344359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.344815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.345589 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:44.346035 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:44.411315 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:44.420599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a5cce695-4b83-4fa2-8920-49f3c02c2b70 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.155724 May 10 14:04:44.421198 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 183/377] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:44 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:44.476690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:44.484044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e6abaa35-12ba-4338-af44-bd525fcff688 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.151089 May 10 14:04:44.484611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 195/378] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:44 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:45.436985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:45.437607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:45.443928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.444382 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.445152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.445592 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.501217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:45.501859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:45.508311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.509296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.510079 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:45.510543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:45.709829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:45.719873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-381f94f9-149b-4246-b1d3-1959542d202a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.222817 May 10 14:04:45.721042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 196/379] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:45 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:45.751373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:45.759102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4d8b1ef4-25d8-4d5b-b895-1e040ad83906 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.325360 May 10 14:04:45.759788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 184/380] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:45 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:46.737533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:46.738345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:46.744749 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.745294 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.746130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.746742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.776206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:46.776903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:46.786446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.786896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.787683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:46.788110 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:46.917112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:46.924703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3a2cc7ba-83d0-4e98-bf89-e2db149edb85 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.191743 May 10 14:04:46.925281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 197/381] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:46 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:46.966836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:46.974172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9260c066-c6ec-4bb2-9a65-b33b3d287f9a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1319 microversion: 2.1 time: 0.202195 May 10 14:04:46.974775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 185/382] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:46 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:47.942217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:47.942845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:47.948811 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.949266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:47.950043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.950517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:47.990936 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:47.991549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:47.998990 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:47.999447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:48.000228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:48.000673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:48.079828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:48.088110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-117685c7-51ee-47fd-9a30-de628e7b1bb0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.149776 May 10 14:04:48.088662 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 198/383] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:47 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:48.129295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:48.136533 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-678d50d9-7975-4910-9fdd-8572c8287989 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1508 microversion: 2.1 time: 0.149381 May 10 14:04:48.137101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 186/384] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:47 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:04:48.418949 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-98c3e70f-dc1a-4478-ad67-a7537a9cc2c2 req-175da556-4318-423b-ae1b-143a1ca6fc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "name": "network-vif-plugged", "status": "completed", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:48.429586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-98c3e70f-dc1a-4478-ad67-a7537a9cc2c2 req-175da556-4318-423b-ae1b-143a1ca6fc01 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:48.430647 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-98c3e70f-dc1a-4478-ad67-a7537a9cc2c2 req-175da556-4318-423b-ae1b-143a1ca6fc01 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:48.443691 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-98c3e70f-dc1a-4478-ad67-a7537a9cc2c2 req-175da556-4318-423b-ae1b-143a1ca6fc01 service nova] Creating event network-vif-plugged:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:04:48.449075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-98c3e70f-dc1a-4478-ad67-a7537a9cc2c2 req-175da556-4318-423b-ae1b-143a1ca6fc01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035527 May 10 14:04:48.449694 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 199/385] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:49.104682 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:49.105909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:49.112416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.112851 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.113542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:49.113967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:49.249254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:49.256607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-20e139be-af08-4596-a478-5cf23f87e7a7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.155967 May 10 14:04:49.257191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 187/386] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:49 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:50.275167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:50.275819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:50.281795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.282273 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.283040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:50.283474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:50.417747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:50.426222 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0cb25629-bf8e-49b1-87e0-16ddea6333d6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.155757 May 10 14:04:50.426920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 200/387] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:50 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:51.443051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:51.443664 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:51.450343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:51.450810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:51.451639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:51.452082 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:51.587460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:51.600597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b8c6ebff-f5a1-4f27-9aa0-3ca5981c622c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1372 microversion: 2.1 time: 0.161369 May 10 14:04:51.601790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 188/388] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:51 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:52.619218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:52.619924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:52.625942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.626433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:52.627212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.627642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:52.762129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:52.769518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f5214cb5-660b-42cf-96ae-2021d2d53808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1566 microversion: 2.1 time: 0.155081 May 10 14:04:52.769988 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 201/389] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:52 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:04:52.785638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:52.786162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:52.792644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.793091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:52.793879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:52.794360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:52.877263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-92df2aba-4b7b-45e1-8331-0af16c8a88c0 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095461 May 10 14:04:52.877864 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 189/390] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:04:52 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:54.262424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-4ad5a562-6194-4a86-88ee-61727045d5b8 req-0382bd44-f04a-47be-b4ff-50cf4bf34a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:54.270629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-4ad5a562-6194-4a86-88ee-61727045d5b8 req-0382bd44-f04a-47be-b4ff-50cf4bf34a3f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:54.271071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-4ad5a562-6194-4a86-88ee-61727045d5b8 req-0382bd44-f04a-47be-b4ff-50cf4bf34a3f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:54.282684 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-4ad5a562-6194-4a86-88ee-61727045d5b8 req-0382bd44-f04a-47be-b4ff-50cf4bf34a3f service nova] Creating event network-changed:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:04:54.287654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-4ad5a562-6194-4a86-88ee-61727045d5b8 req-0382bd44-f04a-47be-b4ff-50cf4bf34a3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029243 May 10 14:04:54.288241 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 202/391] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:04:58.689468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1196663833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-91343943", "security_groups": [{"name": "tempest-secgroup-smoke-352986649"}], "networks": [{"uuid": "6e8d5f7c-533b-4814-abdc-d66c4b31bf48"}], "block_device_mapping_v2": [{"uuid": "d0da1beb-21a0-4613-9023-bd5aec0a7dec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:04:58.810487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] validate_networks() for [('6e8d5f7c-533b-4814-abdc-d66c4b31bf48', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:04:59.177548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:04:59.177977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:04:59.178499 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:04:59.178910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:04:59.179318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:04:59.188997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:59.189441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:59.190268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:04:59.190698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:04:59.207170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Getting quotas for project a9cb94e930984858b30744fc14ca334e. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:04:59.211276 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Getting quotas for user 56462e4305424b099473d1e42adab9a9 and project a9cb94e930984858b30744fc14ca334e. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:04:59.268967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:04:59.271181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0da1beb-21a0-4613-9023-bd5aec0a7dec',volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:04:59.401284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1386806e-37f2-4830-9922-ab397f4f850b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716033 May 10 14:04:59.402411 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 190/392] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:04:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:04:59.412787 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-28892aba-3d8a-4566-80fc-42df8b96ef06 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:04:59.413475 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-28892aba-3d8a-4566-80fc-42df8b96ef06 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:04:59.472102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-28892aba-3d8a-4566-80fc-42df8b96ef06 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:04:59.479680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-28892aba-3d8a-4566-80fc-42df8b96ef06 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1087 microversion: 2.1 time: 0.071111 May 10 14:04:59.480323 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 203/393] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:04:59 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:00.497229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:00.497854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:00.504134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:00.504587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:00.505359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:00.506014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:00.590821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:00.598477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9ea08169-86a1-484a-a1a4-b52416dfc82e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1203 microversion: 2.1 time: 0.105847 May 10 14:05:00.599052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 191/394] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:00 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1203 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:01.616267 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:01.616706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:01.623384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:01.623824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:01.624602 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:01.625019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:01.765117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:01.772612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e7e755b6-1338-4150-a5ed-7e78921b6502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1270 microversion: 2.1 time: 0.160888 May 10 14:05:01.773190 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 204/395] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:01 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:01.891611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-64144317-2f25-497c-9a7e-02b4b9c13b1a req-86276ced-878e-4879-b760-302d750adc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:01.901465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-64144317-2f25-497c-9a7e-02b4b9c13b1a req-86276ced-878e-4879-b760-302d750adc95 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:01.901911 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-64144317-2f25-497c-9a7e-02b4b9c13b1a req-86276ced-878e-4879-b760-302d750adc95 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:01.913086 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-64144317-2f25-497c-9a7e-02b4b9c13b1a req-86276ced-878e-4879-b760-302d750adc95 service nova] Creating event network-changed:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:05:01.918890 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-64144317-2f25-497c-9a7e-02b4b9c13b1a req-86276ced-878e-4879-b760-302d750adc95 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030898 May 10 14:05:01.919882 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 192/396] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:02.789263 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:02.789869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:02.796130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:02.796593 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:02.797357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:02.797787 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:02.924476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:02.931706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7aca4ed5-7829-4011-98c4-574d5877abe8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.146290 May 10 14:05:02.932260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 205/397] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:02 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:03.949435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:03.950134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:03.956193 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.956646 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:03.957414 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:03.957854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:04.096649 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:04.105264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ed88c0c5-28ea-4beb-a088-2cf712172f47 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.160343 May 10 14:05:04.105847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 193/398] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:03 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:05.122903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:05.123437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:05.129371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.129821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.130630 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:05.131062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:05.468223 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:05.477438 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cb5e48e1-611e-4919-a0e9-d6fa3985c9ae tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.359303 May 10 14:05:05.478002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 206/399] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:05 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:06.495277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:06.495892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:06.502470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.502931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.503704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:06.504147 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:06.629649 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:06.637691 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f983f8b1-6471-4f6e-aac0-2cde3db27c51 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.147067 May 10 14:05:06.638372 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 194/400] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:06 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:07.654103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:07.654743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:07.660684 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.661135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.661896 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:07.662369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:07.790081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:07.797935 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-298565f2-b33d-419a-a3c0-9075ce397639 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.148194 May 10 14:05:07.798524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 207/401] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:07 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:08.048027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:08.048542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:08.054808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.055264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.056034 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.056479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.081049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e7c4e74b-1d08-4e3f-b492-0c236043bdd5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.037121 May 10 14:05:08.081813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 195/402] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:05:08 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:08.814081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:08.814732 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:08.820751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.821193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.821945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:08.822412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:08.953164 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:08.960683 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e01425e7-6db1-4437-8edd-29075332fc89 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.150413 May 10 14:05:08.961277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 208/403] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:08 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:09.978427 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:09.979228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:09.985896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.986395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:09.987168 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:09.987610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.119965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:10.127280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-11f09524-1c37-43af-8349-5c9e181a731a tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.153624 May 10 14:05:10.127844 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 196/404] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:09 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:10.469543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237f405e-2510-464b-8ebf-f781162fa7b1"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:10.470716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:10.476758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.477199 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:10.477953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:10.478414 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.051851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-170deb58-b060-404a-ac07-15023c7b661d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585974 May 10 14:05:11.052473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 209/405] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:05:10 2022] POST /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments => generated 194 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:11.143824 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:11.144451 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:11.151320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.151878 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.152640 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:11.153072 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:11.286579 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:11.293879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4aa3b866-9a08-4f66-a031-af4fb196a88e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.153832 May 10 14:05:11.294485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 197/406] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:11 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:12.311350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:12.312046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:12.318704 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.319145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.319897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:12.320326 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:12.450677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:12.458225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a285fb0b-fb2a-42b5-a463-1fd8b346f595 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.151072 May 10 14:05:12.458910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 210/407] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:12 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:13.475816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:13.476438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:13.483367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.483812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.484562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.484992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.613570 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:13.621178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bb1bf8e3-b540-47a9-8a82-33aa8a39020e tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.149227 May 10 14:05:13.621747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 198/408] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:13 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:13.758321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "930c878a-6e98-4966-b628-8343c0947c75", "device": "/dev/sdb"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:13.760204 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:13.766489 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.766942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:13.767703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:13.768138 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.001087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a607e2f4-affb-43ae-923b-b87e0cfd9e67 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "POST /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246460 May 10 14:05:14.001623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 211/409] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:05:13 2022] POST /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:14.510815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-b4aa5115-9b28-4489-829e-d41492f74899 req-b8a3860e-7569-43ab-8d11-a74c99a31e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "name": "network-vif-plugged", "status": "completed", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:14.519867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-b4aa5115-9b28-4489-829e-d41492f74899 req-b8a3860e-7569-43ab-8d11-a74c99a31e65 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.520342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-b4aa5115-9b28-4489-829e-d41492f74899 req-b8a3860e-7569-43ab-8d11-a74c99a31e65 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.532076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-b4aa5115-9b28-4489-829e-d41492f74899 req-b8a3860e-7569-43ab-8d11-a74c99a31e65 service nova] Creating event network-vif-plugged:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:05:14.537048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-b4aa5115-9b28-4489-829e-d41492f74899 req-b8a3860e-7569-43ab-8d11-a74c99a31e65 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030886 May 10 14:05:14.537655 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 199/410] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:05:14.639813 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:14.640521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:14.646673 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.647123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.647892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:14.648332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:14.795532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:14.802873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-db26bc41-3522-4690-899d-dad4d917e8dd tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.168645 May 10 14:05:14.803446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 212/411] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:14 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:15.820966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:15.821661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:15.828584 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.829031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:15.829803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:15.830268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:15.963724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:15.971033 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-de0f990a-999e-443c-8fba-0fa18cf9472b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1258 microversion: 2.1 time: 0.154696 May 10 14:05:15.971609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 200/412] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:15 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:16.987058 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:16.987672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:16.994390 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:16.994862 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:16.995831 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:16.996267 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.128679 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:17.136640 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b41e95c8-eb5d-42bf-9329-76b9fb7542c8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1442 microversion: 2.1 time: 0.153743 May 10 14:05:17.137206 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 213/413] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:16 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:17.153453 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:17.154164 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:17.160488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.160938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.161699 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:17.162135 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:17.293007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:17.300381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d470ee02-cee3-47ba-a535-7e4daca24952 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1442 microversion: 2.1 time: 0.151304 May 10 14:05:17.300944 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 201/414] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:17 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1442 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:18.544072 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0dbbef52-421d-4143-aea2-9d01365af82e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: .version_select at 0x7efd5639f790>, body: {"keypair": {"name": "tempest-keypair-1644428312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUTAM9dwD5c/W9OSyHPaL7o/HWrms04YYb17yxOzHaV5Rh8b1Nb1JTkxFtRR35clka5KdsjYGIp6VBbF9qN71dylme7uxOJdhF3EQe+FrB339CJNLwdJtH3IprFbj74qg=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:18.558885 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-0dbbef52-421d-4143-aea2-9d01365af82e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:05:18.563068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-0dbbef52-421d-4143-aea2-9d01365af82e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:05:18.586049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0dbbef52-421d-4143-aea2-9d01365af82e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046074 May 10 14:05:18.586697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 214/415] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:05:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:19.137729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-79858c3c-9646-4ddd-8358-448d01d6a5e7 req-8ff0b1c2-e09c-49a5-bf4c-6f20a8335537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:19.145889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-79858c3c-9646-4ddd-8358-448d01d6a5e7 req-8ff0b1c2-e09c-49a5-bf4c-6f20a8335537 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:19.146368 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-79858c3c-9646-4ddd-8358-448d01d6a5e7 req-8ff0b1c2-e09c-49a5-bf4c-6f20a8335537 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:19.157379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-79858c3c-9646-4ddd-8358-448d01d6a5e7 req-8ff0b1c2-e09c-49a5-bf4c-6f20a8335537 service nova] Creating event network-changed:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:05:19.162432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-79858c3c-9646-4ddd-8358-448d01d6a5e7 req-8ff0b1c2-e09c-49a5-bf4c-6f20a8335537 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029201 May 10 14:05:19.163184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 202/416] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:20.632935 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-375842057", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c07cd0-6152-43ba-84e4-0ef3e3d224df"}], "security_groups": [{"name": "tempest-securitygroup--767165938"}], "key_name": "tempest-keypair-1644428312", "user_data": "}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:20.734128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] validate_networks() for [('49c07cd0-6152-43ba-84e4-0ef3e3d224df', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:05:21.091059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:05:21.091484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:05:21.091950 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:05:21.092355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:05:21.092789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:05:21.101435 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.101877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.102704 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:21.103164 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:21.119855 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:05:21.124089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:05:21.135908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:05:21.138240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:05:21.184677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1bfe36b6-3f66-4eb2-8715-502d7f9a70e4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.556507 May 10 14:05:21.185343 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 215/417] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:05:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:05:21.196836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b55d3e3a-112c-4bdf-9a7a-ea8c6e5ab698 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:21.197609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b55d3e3a-112c-4bdf-9a7a-ea8c6e5ab698 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:21.253998 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b55d3e3a-112c-4bdf-9a7a-ea8c6e5ab698 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:21.260870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b55d3e3a-112c-4bdf-9a7a-ea8c6e5ab698 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1241 microversion: 2.1 time: 0.069067 May 10 14:05:21.262364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 203/418] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:21 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:22.277761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:22.278414 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:22.285401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.286075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.287049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:22.287566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:22.350246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:22.357871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f6bc83f8-a418-4ce5-8cef-2c9beab4a750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1299 microversion: 2.1 time: 0.084575 May 10 14:05:22.358464 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 216/419] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:22 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:23.375883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:23.376497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:23.384270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.385112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.385907 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.386378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.553561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-56826514-6743-4e49-b68e-c385942a75a9 req-4c25452a-7e8d-4433-8e2e-5b4d1430ab5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73002aaf-a92d-4871-be43-ae3e119a8492", "tag": "2b916a17-cd0b-44b0-98d1-77ec3e3cee35"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:23.569089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-56826514-6743-4e49-b68e-c385942a75a9 req-4c25452a-7e8d-4433-8e2e-5b4d1430ab5f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:23.569857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-56826514-6743-4e49-b68e-c385942a75a9 req-4c25452a-7e8d-4433-8e2e-5b4d1430ab5f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:23.583316 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-56826514-6743-4e49-b68e-c385942a75a9 req-4c25452a-7e8d-4433-8e2e-5b4d1430ab5f service nova] Creating event network-changed:2b916a17-cd0b-44b0-98d1-77ec3e3cee35 for instance 73002aaf-a92d-4871-be43-ae3e119a8492 on hv-cinder-83588 May 10 14:05:23.594845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:23.595105 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-56826514-6743-4e49-b68e-c385942a75a9 req-4c25452a-7e8d-4433-8e2e-5b4d1430ab5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047041 May 10 14:05:23.595721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 217/420] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:23.603335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cab6c135-4ac7-4c70-bab5-b317a561adbe tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.231203 May 10 14:05:23.605132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 204/421] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:23 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:24.622611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:24.623322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:24.629535 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.629986 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.630928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:24.631227 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:24.778499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:24.786634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d811b957-9a0a-4ae9-9850-743dc7274548 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.169481 May 10 14:05:24.787214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 218/422] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:24 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:25.804452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:25.805066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:25.812866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.813408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.814303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:25.814779 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:25.956593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:25.964308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1a355aa6-0f95-4f94-8695-ed6348d60a93 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.163749 May 10 14:05:25.964884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 205/423] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:25 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:26.981032 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:26.981641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:26.987958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.988409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:26.989173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:26.989617 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:27.114447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:27.122411 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-55c33a2d-cb83-4402-88e2-c2792c563141 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.145299 May 10 14:05:27.122979 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 219/424] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:26 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:28.139837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:28.140449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:28.146808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.147261 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.148025 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:28.148461 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:28.276883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:28.284141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ab208d3f-94b5-4499-8660-45ef748e0ef8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.148339 May 10 14:05:28.284705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 206/425] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:28 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:29.301342 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:29.301946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:29.309212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.309658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.310439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:29.310870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:29.438146 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:29.445371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-531a3531-c560-4117-8a69-3a4d4e3fe683 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.147926 May 10 14:05:29.445937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 220/426] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:29 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:30.462220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:30.463430 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:30.469713 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.470166 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.470959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:30.471396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:30.600901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:30.608194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6de39d32-eb4e-451b-a242-e80234f20e6b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.149898 May 10 14:05:30.608760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 207/427] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:30 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:31.625079 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:31.625688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:31.632019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.632472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.633224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:31.633654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:31.758104 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:31.765391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d096be62-485b-44d3-baec-3a25d6a1b57d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.144496 May 10 14:05:31.765953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 221/428] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:31 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:32.782628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:32.783252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:32.789612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.790058 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.790847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:32.791806 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:32.925057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:32.933551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1e8da988-9bf3-4249-8bce-546101998f46 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.154923 May 10 14:05:32.934119 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 208/429] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:32 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:33.950775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:33.951407 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:33.957784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:33.958301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:33.959078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:33.959520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:34.086666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:34.094025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-51c45b54-1f0f-4402-ab73-89fa9bc1985e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.148082 May 10 14:05:34.094633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 222/430] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:33 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:35.110688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:35.111254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:35.117528 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:35.117975 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:35.118766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:35.119849 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:35.243549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:35.252375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-adda631e-1e4a-4ef7-9986-fc3b19ca6b35 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.145555 May 10 14:05:35.252952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 209/431] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:35 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:36.269685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:36.270322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:36.277174 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:36.277628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:36.278465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:36.278930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:36.408230 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:36.415570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9592b4d3-3565-493d-a30b-88dae166e918 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.149717 May 10 14:05:36.416802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 223/432] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:36 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:37.434445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:37.435055 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:37.446318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:37.446318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:37.446318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:37.446318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:37.571543 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:37.578941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-02827d88-2c2d-4e48-a1c7-e4b6ea550453 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.149619 May 10 14:05:37.579501 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 210/433] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:37 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:38.597322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:38.597936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:38.605205 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:38.605826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:38.606900 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:38.607642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:38.738484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:38.746508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1080c1cf-6a4a-4cf0-887c-c82a579173df tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.153913 May 10 14:05:38.747073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 224/434] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:38 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:39.763599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:39.764144 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:39.770567 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:39.771020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:39.771789 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:39.772236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:39.903977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:39.911248 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1d297636-e469-4572-b19f-53252ac16969 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.152167 May 10 14:05:39.911820 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 211/435] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:39 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:40.927864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:40.928504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:40.934651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:40.935106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:40.936102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:40.936761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:41.080169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:41.087434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e8f701d3-7dba-4b1b-9013-c6babed5875a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.163454 May 10 14:05:41.088648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 225/436] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:40 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:42.105440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:42.106052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:42.112694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:42.113145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:42.113913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:42.114381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:42.317954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:42.326083 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-09385cd1-cccc-4767-b8a2-b0a033fefa3f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.225031 May 10 14:05:42.326625 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 212/437] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:42 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:42.716550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-a67881fb-2a43-4b51-a2b4-ec885b161225 req-bb457be3-07c8-487f-aebd-b3ba041c29f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73002aaf-a92d-4871-be43-ae3e119a8492", "name": "network-vif-plugged", "status": "completed", "tag": "2b916a17-cd0b-44b0-98d1-77ec3e3cee35"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:42.725280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a67881fb-2a43-4b51-a2b4-ec885b161225 req-bb457be3-07c8-487f-aebd-b3ba041c29f6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:42.725951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a67881fb-2a43-4b51-a2b4-ec885b161225 req-bb457be3-07c8-487f-aebd-b3ba041c29f6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:42.737104 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-a67881fb-2a43-4b51-a2b4-ec885b161225 req-bb457be3-07c8-487f-aebd-b3ba041c29f6 service nova] Creating event network-vif-plugged:2b916a17-cd0b-44b0-98d1-77ec3e3cee35 for instance 73002aaf-a92d-4871-be43-ae3e119a8492 on hv-cinder-83588 May 10 14:05:42.741984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-a67881fb-2a43-4b51-a2b4-ec885b161225 req-bb457be3-07c8-487f-aebd-b3ba041c29f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029696 May 10 14:05:42.742660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 226/438] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:43.342722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:43.343432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:43.349861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:43.350355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:43.351128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:43.351587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:43.480151 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:43.487312 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0ae70749-710b-4a40-90ae-10458e01bdcc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.148420 May 10 14:05:43.487876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 213/439] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:43 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:44.505771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:44.506502 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:44.513944 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:44.514427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:44.515203 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:44.515642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:44.641701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:44.648911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-79f64438-177d-4499-8832-e80d6edf6043 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1366 microversion: 2.1 time: 0.147945 May 10 14:05:44.649476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 227/440] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:44 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:45.665580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:45.666341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:45.672755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.673203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.673967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.674435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.804182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:45.812184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5df79922-2f63-4971-b871-bbe86f72fc41 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1557 microversion: 2.1 time: 0.150532 May 10 14:05:45.812759 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 214/441] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:45 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:45.829136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:45.829686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:45.836806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.838461 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.839265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:45.839716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:45.918538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b66ef0d2-4a92-4bef-9e93-a660e03e5b15 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093217 May 10 14:05:45.919121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 228/442] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:05:45 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:46.872524 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-f154d35a-923e-4585-8ff6-0c8e6bf77727 req-2c5a0bbb-8c1f-4a00-9a34-2196de6539b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73002aaf-a92d-4871-be43-ae3e119a8492", "tag": "2b916a17-cd0b-44b0-98d1-77ec3e3cee35"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:46.880899 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-f154d35a-923e-4585-8ff6-0c8e6bf77727 req-2c5a0bbb-8c1f-4a00-9a34-2196de6539b1 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:46.881343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-f154d35a-923e-4585-8ff6-0c8e6bf77727 req-2c5a0bbb-8c1f-4a00-9a34-2196de6539b1 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:46.892754 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-f154d35a-923e-4585-8ff6-0c8e6bf77727 req-2c5a0bbb-8c1f-4a00-9a34-2196de6539b1 service nova] Creating event network-changed:2b916a17-cd0b-44b0-98d1-77ec3e3cee35 for instance 73002aaf-a92d-4871-be43-ae3e119a8492 on hv-cinder-83588 May 10 14:05:46.898009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-f154d35a-923e-4585-8ff6-0c8e6bf77727 req-2c5a0bbb-8c1f-4a00-9a34-2196de6539b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029841 May 10 14:05:46.898707 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 215/443] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:46.960213 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:46.960742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:46.970111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:46.970777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:46.971583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:46.972009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:47.105032 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lazy-loading 'services' on Instance uuid cfc8a7c1-1aa5-45f6-acc9-8443931fe72b {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:05:47.221248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-aa54fd2d-bd31-4a0b-92f9-2b6e0968fe82 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b/os-volume_attachments/930c878a-6e98-4966-b628-8343c0947c75" status: 202 len: 0 microversion: 2.1 time: 0.265149 May 10 14:05:47.225401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 229/444] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:05:46 2022] DELETE /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b/os-volume_attachments/930c878a-6e98-4966-b628-8343c0947c75 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:05:48.354327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:48.354922 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:48.361052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.361506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.362435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.362884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.389252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:05:48.472342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f38b63a3-3e4d-4c63-9e39-60aa981aa830 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 204 len: 0 microversion: 2.1 time: 0.122815 May 10 14:05:48.472962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 216/445] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:05:48 2022] DELETE /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:05:48.483144 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:48.483854 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:48.490050 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.490654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.491426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:48.491870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:48.621529 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:48.628916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ff5204a0-6f27-45c2-916a-9e40ff5f7e6c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1514 microversion: 2.1 time: 0.151529 May 10 14:05:48.629473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 230/446] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:48 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:05:49.646544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:49.647273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:49.654281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:49.654690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:49.655463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:49.655904 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:49.787169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:49.795080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-807bfd4f-0fc2-4eec-a115-4684cdc5a684 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1514 microversion: 2.1 time: 0.152855 May 10 14:05:49.795645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 217/447] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:49 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:50.812619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:50.813953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-5b05e675-370c-432a-beb6-5154464c0044 req-f15d83de-6054-4c66-900a-473fde68b75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc8a7c1-1aa5-45f6-acc9-8443931fe72b", "name": "network-vif-deleted", "tag": "95692f19-6cbf-48e7-a04c-e51b4b06d49a"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:05:50.814559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:50.821416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:50.821882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:50.822816 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:50.823275 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:50.823703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-5b05e675-370c-432a-beb6-5154464c0044 req-f15d83de-6054-4c66-900a-473fde68b75a service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:50.824160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-5b05e675-370c-432a-beb6-5154464c0044 req-f15d83de-6054-4c66-900a-473fde68b75a service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:50.836052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-5b05e675-370c-432a-beb6-5154464c0044 req-f15d83de-6054-4c66-900a-473fde68b75a service nova] Creating event network-vif-deleted:95692f19-6cbf-48e7-a04c-e51b4b06d49a for instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b on hv-cinder-83588 May 10 14:05:50.841364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-5b05e675-370c-432a-beb6-5154464c0044 req-f15d83de-6054-4c66-900a-473fde68b75a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031013 May 10 14:05:50.842233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 218/448] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:05:50.897405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:05:50.905168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-839f6181-68f7-4fcc-a2e8-dc7f1961b630 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 200 len: 1304 microversion: 2.1 time: 0.096489 May 10 14:05:50.906052 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 231/449] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:50 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:05:51.923815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:05:51.924518 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cfc8a7c1-1aa5-45f6-acc9-8443931fe72b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:05:51.930703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:51.931166 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:51.931936 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:05:51.932374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:05:51.945292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] HTTP exception thrown: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Request method failure captured: May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b HTTP/1.1 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienDch4mG3PX8d7RLGqJGUGB18Y8yNG13hgkfAudP8wDDXygbIXUSgoW3IEqGuLbUHTh56T47TFPhll9gi5T-9JGvc2FotchDJAbJWjdr2D1jGXBgO8S8QJj_9yPXd_7_czXYoVuJEEup2h2SzrUEXPJTUkvMnVUxg_YsTLTQTLhpGe4 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 0305a36033ca4831b0bcba8a9b3c5a27 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:05:51.946924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0305a36033ca4831b0bcba8a9b3c5a27", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 0305a36033ca4831b0bcba8a9b3c5a27 May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesSnapshotTestJSON-1570477854-project May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: acdd7d7f383f4399ae863e65b10c4586 May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesSnapshotTestJSON-1570477854-project May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. May 10 14:05:51.948462 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'cfc8a7c1-1aa5-45f6-acc9-8443931fe72b'} May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:05:51.949432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. May 10 14:05:51.950770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:05:51.952010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Returning 404 to user: Instance cfc8a7c1-1aa5-45f6-acc9-8443931fe72b could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:05:51.952010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-21231330-02b0-4919-88f2-9b6b52bed8d1 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b" status: 404 len: 111 microversion: 2.1 time: 0.029449 May 10 14:05:51.952010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 219/450] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:05:51 2022] GET /compute/v2.1/servers/cfc8a7c1-1aa5-45f6-acc9-8443931fe72b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:03.843159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-230730067", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "networks": [{"uuid": "18b7924d-bd77-4212-b305-deb3c5f8e9f4"}]}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:03.893090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] validate_networks() for [('18b7924d-bd77-4212-b305-deb3c5f8e9f4', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:06:04.414948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:06:04.415366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:06:04.415839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:06:04.416237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:06:04.416642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:06:04.425919 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:04.426392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:04.427183 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:04.427614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:04.444747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Getting quotas for project 0305a36033ca4831b0bcba8a9b3c5a27. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:06:04.449507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Getting quotas for user acdd7d7f383f4399ae863e65b10c4586 and project 0305a36033ca4831b0bcba8a9b3c5a27. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:06:04.460199 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:06:04.462719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:06:04.507791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8101c3ce-ea58-4781-864a-6df6a8fb7a9b tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668488 May 10 14:06:04.508485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 232/451] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:06:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:06:04.518977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d239f9a8-d440-4516-96ea-cf4bb0494bac tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:04.519585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d239f9a8-d440-4516-96ea-cf4bb0494bac tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:04.575510 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d239f9a8-d440-4516-96ea-cf4bb0494bac tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:04.585385 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d239f9a8-d440-4516-96ea-cf4bb0494bac tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1218 microversion: 2.1 time: 0.070150 May 10 14:06:04.585943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 220/452] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:04 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:05.602765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:05.603462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:05.611325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:05.611866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:05.612785 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:05.613441 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:05.677049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:05.685082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d4a7a9a8-fd27-4cc9-a3b2-f4ddf552ddb9 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1276 microversion: 2.1 time: 0.086775 May 10 14:06:05.685661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 233/453] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:05 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:06.702176 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:06.702815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:06.709101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.709560 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.710369 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.710814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.880173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-8cc19d73-b1ec-409e-b2c8-c83a64b2a0e2 req-47dd576e-5140-469b-b577-6f6437f6f4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b", "tag": "cee61615-4643-4a78-90b6-9f43f793b885"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:06.890713 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-8cc19d73-b1ec-409e-b2c8-c83a64b2a0e2 req-47dd576e-5140-469b-b577-6f6437f6f4df service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:06.891347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-8cc19d73-b1ec-409e-b2c8-c83a64b2a0e2 req-47dd576e-5140-469b-b577-6f6437f6f4df service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:06.904005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-8cc19d73-b1ec-409e-b2c8-c83a64b2a0e2 req-47dd576e-5140-469b-b577-6f6437f6f4df service nova] Creating event network-changed:cee61615-4643-4a78-90b6-9f43f793b885 for instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b on hv-cinder-83588 May 10 14:06:06.910119 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-8cc19d73-b1ec-409e-b2c8-c83a64b2a0e2 req-47dd576e-5140-469b-b577-6f6437f6f4df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034535 May 10 14:06:06.910943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 234/454] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:06.916422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:06.924921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8534d1ed-18ca-49f9-956b-fdcd411ccc5e tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.226640 May 10 14:06:06.925801 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 221/455] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:06 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:07.942206 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:07.942964 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:07.950016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:07.950494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:07.951262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:07.951703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:08.085297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:08.093122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c55e7bbb-d7cb-4a75-b27e-889f8de0cb84 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.155175 May 10 14:06:08.093690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 235/456] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:07 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:09.110287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:09.110824 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:09.116743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.117188 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.117946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:09.118412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:09.246891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:09.253982 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1633497e-e1cf-49c6-98cc-7043e3b284ff tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.147791 May 10 14:06:09.254562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 222/457] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:09 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:10.271004 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:10.271561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:10.278556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.279012 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.279810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:10.280261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:10.407447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:10.414803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dfe88f45-b9e3-4298-b6ba-f5f18505bfc3 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.147865 May 10 14:06:10.415428 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 236/458] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:10 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:11.431790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:11.432404 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:11.438913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.439364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.440132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:11.440569 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:11.568168 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:11.576231 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-269519cc-ad5f-43e3-b001-1048a21ae298 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.148329 May 10 14:06:11.576808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 223/459] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:11 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:12.593497 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:12.594135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:12.600280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.600731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.601494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:12.601931 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:12.731707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:12.738969 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9a053f42-b80f-4e4d-93d8-e85ca141af3a tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.149358 May 10 14:06:12.739568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 237/460] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:12 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:13.756612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:13.757167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:13.763544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:13.763997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.764766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:13.765206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:13.898139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:13.905639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-955551e0-8327-49f8-81f4-93814d786eda tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.153007 May 10 14:06:13.906229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 224/461] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:13 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:14.867126 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-82e49da2-2dd8-425b-9ae5-f7ba3c511785 req-67956a53-8117-46b2-8cfa-060dac76c15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b", "name": "network-vif-plugged", "status": "completed", "tag": "cee61615-4643-4a78-90b6-9f43f793b885"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:14.876096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-82e49da2-2dd8-425b-9ae5-f7ba3c511785 req-67956a53-8117-46b2-8cfa-060dac76c15f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.876544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-82e49da2-2dd8-425b-9ae5-f7ba3c511785 req-67956a53-8117-46b2-8cfa-060dac76c15f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.888048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-82e49da2-2dd8-425b-9ae5-f7ba3c511785 req-67956a53-8117-46b2-8cfa-060dac76c15f service nova] Creating event network-vif-plugged:cee61615-4643-4a78-90b6-9f43f793b885 for instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b on hv-cinder-83588 May 10 14:06:14.892895 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-82e49da2-2dd8-425b-9ae5-f7ba3c511785 req-67956a53-8117-46b2-8cfa-060dac76c15f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029454 May 10 14:06:14.893485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 238/462] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:14.922881 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:14.923500 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:14.930990 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.931429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:14.932203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:14.932637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:15.111631 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:15.119051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e3115b0a-fa85-4c06-8c74-cc0cc815c2dd tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.200118 May 10 14:06:15.120090 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 225/463] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:14 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:16.137033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:16.137641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:16.143706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.144153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.144910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:16.145339 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:16.272719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:16.280608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5e420d9b-187a-4e7f-bf19-6cc3a69de635 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1318 microversion: 2.1 time: 0.148264 May 10 14:06:16.281187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 239/464] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:16 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:17.297071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:17.297608 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:17.304246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.304704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.305481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.306474 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.432828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:17.440076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6d32f340-2121-4aad-8220-3e7718c78d4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1507 microversion: 2.1 time: 0.146974 May 10 14:06:17.440635 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 226/465] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:17 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:17.456146 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bb591b1-aae1-49b2-a069-1bae20fc3bab", "device": "/dev/sdb"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:17.457247 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:17.463888 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.464346 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.465155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:17.465633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:17.731762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0d759447-9b8c-4fdf-9069-4ce7ca6c6099 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "POST /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279510 May 10 14:06:17.732365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 240/466] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:06:17 2022] POST /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:28.804384 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:28.804908 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:28.812376 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.812827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.813596 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:28.814029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:28.838089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-18880bfc-b6b0-419c-9bb9-dcb8108e2c67 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/ips" status: 200 len: 144 microversion: 2.1 time: 0.037630 May 10 14:06:28.838688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 227/467] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:06:28 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:31.816720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a06314c9-9674-46bf-a740-59619fc646df"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:31.817856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:31.824544 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.824992 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:31.825751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:31.826180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:32.075099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-75370f82-be0a-46e4-8ae4-28e721891681 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262968 May 10 14:06:32.075702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 241/468] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:06:31 2022] POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:06:40.068102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:40.068664 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:40.075263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.075706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.076468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:40.076899 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:40.377792 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lazy-loading 'services' on Instance uuid cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:06:40.501880 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6aae4888-76da-4772-aa19-20c07fd94b4c tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b/os-volume_attachments/0bb591b1-aae1-49b2-a069-1bae20fc3bab" status: 202 len: 0 microversion: 2.1 time: 0.437705 May 10 14:06:40.502552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 228/469] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:06:40 2022] DELETE /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b/os-volume_attachments/0bb591b1-aae1-49b2-a069-1bae20fc3bab => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:43.760015 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b899ed24-13e4-484b-99e5-3a600cef0ab3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:43.766161 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b899ed24-13e4-484b-99e5-3a600cef0ab3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:43.766709 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b899ed24-13e4-484b-99e5-3a600cef0ab3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:43.826235 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b899ed24-13e4-484b-99e5-3a600cef0ab3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Going to try to stop instance {{(pid=117186) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 14:06:43.869597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b899ed24-13e4-484b-99e5-3a600cef0ab3 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action" status: 202 len: 0 microversion: 2.1 time: 0.113904 May 10 14:06:43.873651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 242/470] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:06:43 2022] POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:06:43.879738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:43.880454 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:43.887800 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:43.888290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:43.889122 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:43.889587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.020480 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:44.029092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dbe95858-6806-4fdd-b199-61f3e217e9a6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.154141 May 10 14:06:44.029668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 229/471] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:43 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:44.786287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:44.786872 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:44.793018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.793472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.794256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.794696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.819282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:06:44.892339 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6c3b89d5-58ea-4034-894e-bb6d1c6f9524 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 204 len: 0 microversion: 2.1 time: 0.110468 May 10 14:06:44.893374 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 243/472] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:06:44 2022] DELETE /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:06:44.901813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:44.902463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:44.908790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.909246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:44.910021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:44.910493 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:45.039909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:45.046911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:45.047604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:45.047716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-551c4208-8786-45ff-9142-c4267108ad12 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1513 microversion: 2.1 time: 0.150068 May 10 14:06:45.048338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 230/473] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:44 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:45.053941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:45.054424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:45.055191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:45.056410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:45.239145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:45.247615 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8337e0e6-d852-4d9f-ad3c-636cc6168b30 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.204935 May 10 14:06:45.248179 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 244/474] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:45 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:45.878495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:06:45.878671 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:06:46.065299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:46.065944 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:46.076610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:46.077060 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:46.077868 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:46.078327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:46.204004 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:46.211221 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-624b25d9-0e3a-4755-a446-5a0178d79d1f tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1513 microversion: 2.1 time: 0.149822 May 10 14:06:46.211837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 231/475] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:46 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:46.265495 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:46.266100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:46.272415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:46.272872 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:46.273646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:46.274086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:46.399856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:46.407675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-448705c8-df3f-4319-81a6-bafd4d8b2e6e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.145993 May 10 14:06:46.408188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 245/476] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:46 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:47.228647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:47.229200 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:47.235612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:47.236068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:47.236837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:47.237284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:47.424724 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:47.425390 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:47.431393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:47.431840 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:47.432619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:47.433056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:47.440500 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acdd7d7f383f4399ae863e65b10c4586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0305a36033ca4831b0bcba8a9b3c5a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:47.448572 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-51c9480e-38b5-4682-ac2d-f91dab7d3320 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 200 len: 1513 microversion: 2.1 time: 0.224485 May 10 14:06:47.449371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 232/477] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:47 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:47.564489 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:47.572380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f31e1652-1041-4bfa-ac7b-7d4fca625380 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.151452 May 10 14:06:47.572945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 246/478] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:47 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:06:47.773925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-73830008-abd8-4e5b-a2a2-4de4ee8bac93 req-68ae1026-5617-4d2e-8911-1ad629967346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b", "name": "network-vif-deleted", "tag": "cee61615-4643-4a78-90b6-9f43f793b885"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:06:47.784714 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-73830008-abd8-4e5b-a2a2-4de4ee8bac93 req-68ae1026-5617-4d2e-8911-1ad629967346 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:47.785192 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-73830008-abd8-4e5b-a2a2-4de4ee8bac93 req-68ae1026-5617-4d2e-8911-1ad629967346 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:47.797619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-73830008-abd8-4e5b-a2a2-4de4ee8bac93 req-68ae1026-5617-4d2e-8911-1ad629967346 service nova] Creating event network-vif-deleted:cee61615-4643-4a78-90b6-9f43f793b885 for instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b on hv-cinder-83588 May 10 14:06:47.803275 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-73830008-abd8-4e5b-a2a2-4de4ee8bac93 req-68ae1026-5617-4d2e-8911-1ad629967346 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033110 May 10 14:06:47.803877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 233/479] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:06:48.466080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:48.466643 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] [instance: cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:48.473480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:48.473930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:48.474735 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:48.475173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:48.489656 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] HTTP exception thrown: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Request method failure captured: May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b HTTP/1.1 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienDch4mG3PX8d7RLGqJGUGB18Y8yNG13hgkfAudP8wDDXygbIXUSgoW3IEqGuLbUHTh56T47TFPhll9gi5T-9JGvc2FotchDJAbJWjdr2D1jGXBgO8S8QJj_9yPXd_7_czXYoVuJEEup2h2SzrUEXPJTUkvMnVUxg_YsTLTQTLhpGe4 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 0305a36033ca4831b0bcba8a9b3c5a27 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:06:48.491408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/0305a36033ca4831b0bcba8a9b3c5a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_0305a36033ca4831b0bcba8a9b3c5a27", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 0305a36033ca4831b0bcba8a9b3c5a27 May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1570477854 May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesSnapshotTestJSON-1570477854-project May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: acdd7d7f383f4399ae863e65b10c4586 May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesSnapshotTestJSON-1570477854-project May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. May 10 14:06:48.492752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b'} May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:06:48.493624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. May 10 14:06:48.494883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:06:48.496228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] Returning 404 to user: Instance cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:06:48.496228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3ceec49e-6f95-4043-95a5-4082446c2976 tempest-VolumesSnapshotTestJSON-1570477854 tempest-VolumesSnapshotTestJSON-1570477854-project] 10.222.0.32 "GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b" status: 404 len: 111 microversion: 2.1 time: 0.031506 May 10 14:06:48.496228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 247/480] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:48 2022] GET /compute/v2.1/servers/cd5c6a1b-1300-4bf6-a23e-2cc8e1f0ce6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:06:48.590062 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:48.590799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:48.597208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:48.597660 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:48.598465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:48.598902 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:48.739024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:48.749657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2510ba39-2ff3-4402-8624-9a987f0b85e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.164065 May 10 14:06:48.761162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 234/481] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:48 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:49.768150 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:49.768768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:49.775916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:49.776373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:49.777184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:49.777624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:49.916301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:49.924633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a7a7cb8b-8918-406c-bc6e-4eeccf71f1e8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.160251 May 10 14:06:49.925272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 248/482] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:49 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:50.942642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:50.943264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:50.950618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:50.951073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:50.951836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:50.952277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:51.079327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:51.087504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1ff8bf85-3f89-4c78-ba3a-d428fe4b3dc5 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.148633 May 10 14:06:51.088096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 235/483] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:50 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:52.104622 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:52.105229 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:52.111597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:52.111989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:52.112752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:52.113193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:52.239420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:52.248043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6ee5af49-1791-4b8d-be1b-f8988e75ce0e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.147381 May 10 14:06:52.248635 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 249/484] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:52 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:53.265276 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:53.265889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:53.272453 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:53.272850 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:53.273623 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:53.274057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:53.409544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:53.417564 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-92aba432-5b68-4924-8e22-7db48ff353e4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.156085 May 10 14:06:53.418128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 236/485] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:53 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:54.436073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:54.436589 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:54.442922 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:54.443370 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:54.444125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:54.444556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:54.574786 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:54.582595 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d0a546d4-464d-4300-9c74-2bd289144824 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.150622 May 10 14:06:54.583170 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 250/486] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:54 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:55.599498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:55.600102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:55.607007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:55.607450 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:55.608225 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:55.608638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:55.738772 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:55.747799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-234cfa99-f28a-4214-81fd-d1e547da4016 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.152137 May 10 14:06:55.748364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 237/487] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:55 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:56.764997 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:56.765610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:56.771952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:56.772406 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:56.773171 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:56.773604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:56.908286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:56.916196 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c3b39852-a430-4073-8254-d9048e28ca44 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.155132 May 10 14:06:56.916760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 251/488] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:56 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:57.932933 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:57.933613 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:57.940291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:57.940745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:57.941511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:57.941948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:58.068955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:58.077186 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7ededf49-9bb9-488a-bf11-15c2c9d775d6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.148257 May 10 14:06:58.077749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 238/489] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:57 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:06:59.094389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:06:59.095098 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:06:59.101385 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:59.101839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:59.103274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:06:59.103720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:06:59.239009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:06:59.247594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-38387857-05c4-4383-b57f-e69e4ebcc645 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1722 microversion: 2.1 time: 0.157395 May 10 14:06:59.248174 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 252/490] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:06:59 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:00.264761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:00.265375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:00.271657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:00.272107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:00.272866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:00.273304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:00.405611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:00.413293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-99645e78-e8a7-42c3-8ae7-322be0dace68 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1699 microversion: 2.1 time: 0.152488 May 10 14:07:00.413859 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 239/491] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:00 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:00.430143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-18b003ff-cacb-484f-9983-0ffeb4defe24 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:00.437376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18b003ff-cacb-484f-9983-0ffeb4defe24 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:00.437829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18b003ff-cacb-484f-9983-0ffeb4defe24 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:00.464218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-18b003ff-cacb-484f-9983-0ffeb4defe24 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Going to try to start instance {{(pid=117186) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 14:07:00.506708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-18b003ff-cacb-484f-9983-0ffeb4defe24 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action" status: 202 len: 0 microversion: 2.1 time: 0.080222 May 10 14:07:00.507315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 253/492] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:07:00 2022] POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:00.515551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:00.516085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:00.521864 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:00.522440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:00.523116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:00.523546 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:00.650540 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:00.658257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d4c6ff9f-4ef9-4d40-8dce-42f828a54805 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1708 microversion: 2.1 time: 0.146573 May 10 14:07:00.658831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 240/493] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:00 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1708 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:01.677345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:01.678043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:01.685344 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.685818 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.686625 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:01.687089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:01.816513 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:01.824851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d47e93d8-a4fe-4de8-80b5-319ca74f4ee6 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1708 microversion: 2.1 time: 0.151668 May 10 14:07:01.825414 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 254/494] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:01 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:02.842419 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:02.843029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:02.849371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:02.849819 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:02.850611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:02.851052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:02.980219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:02.988022 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5b17d930-d925-4d25-a06c-c6bf4f924480 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1708 microversion: 2.1 time: 0.149466 May 10 14:07:02.988589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 241/495] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:02 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:04.005497 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:04.006106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:04.012613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:04.013062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:04.013818 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:04.014276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:04.139699 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:04.147477 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2a171835-5a1a-4d8f-8d28-f8151a2b136d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1708 microversion: 2.1 time: 0.145804 May 10 14:07:04.148048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 255/496] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:04 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1708 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:05.164767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:05.165330 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:05.171907 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.172359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.173125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:05.173560 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:05.305169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:05.313497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-73ef826c-8c7b-4bc4-a721-3bfcdbc52d0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1712 microversion: 2.1 time: 0.152677 May 10 14:07:05.314056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 242/497] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:05 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:26.292596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f7569fb-5a56-485c-9c96-3db24293a793"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:26.293708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:26.300569 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:26.301011 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:26.301768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:26.302214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:26.534021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b7679ff8-4097-41fb-9aef-89abbbd36c3b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467361 May 10 14:07:26.534669 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 256/498] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:07:26 2022] POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:07:34.029716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:34.031525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:34.037453 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.037906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.038720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.039165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.060953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lazy-loading 'flavor' on Instance uuid 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:07:34.224344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-653f6539-c21d-4168-9ca6-61eb043f13ec tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/action" status: 200 len: 32 microversion: 2.1 time: 0.198587 May 10 14:07:34.224952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 243/499] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:07:34 2022] POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:07:34.235245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:34.235961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:34.242295 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.242834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.243578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:34.244001 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:34.376145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:34.384139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-68beccb2-7cdc-448b-9e4a-f01386a7baef tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.153863 May 10 14:07:34.384800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 257/500] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:34 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:35.403438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:35.404172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:35.410488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:35.410947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:35.411718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:35.412162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:35.543976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:35.552338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8132e577-bc11-4639-b1ca-fda4475b7593 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.153634 May 10 14:07:35.552898 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 244/501] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:35 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:36.569148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:36.569753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:36.576042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:36.576487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:36.577238 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:36.578345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:36.707266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:36.715258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3b458e70-9c3d-422a-9ec3-25d2e42626b6 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.149969 May 10 14:07:36.715824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 258/502] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:36 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:37.732780 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:37.733427 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:37.739680 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.740128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.740892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:37.741330 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:37.867753 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:37.876283 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-72da1fd9-4241-4dc9-8b28-eabf4a8552fb tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.147399 May 10 14:07:37.876843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 245/503] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:37 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:38.893890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:38.894549 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:38.900911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:38.901365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:38.902132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:38.902601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:39.033476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:39.041317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c50dd9e7-f8f3-43c7-99d0-fe84849e6125 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.152060 May 10 14:07:39.041888 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 259/504] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:38 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:40.058988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:40.059606 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:40.066581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:40.067039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:40.067806 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:40.068243 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:40.197932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:40.206439 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4b80d2e6-d935-4a59-8799-c5142dd38b5e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.152174 May 10 14:07:40.207012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 246/505] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:40 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:41.224512 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:41.225037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:41.231430 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:41.231890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:41.232660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:41.233100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:41.370160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:41.378660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-91b2b468-815b-4312-a05e-278b3d4fde32 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.158138 May 10 14:07:41.379224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 260/506] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:41 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:42.395947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:42.396589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:42.403045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:42.403497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:42.404303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:42.404774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:42.545795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:42.554736 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5c20bf09-15b6-483d-bd5c-e35d4b87a6e9 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.162673 May 10 14:07:42.555323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 247/507] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:42 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:43.572070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:43.572691 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:43.579563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:43.580012 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:43.580774 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:43.581212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:43.707714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:43.715458 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-18722211-3b90-472a-8868-8ef73b916169 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.147266 May 10 14:07:43.716023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 261/508] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:43 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:44.732979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:44.734483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:44.741073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:44.741527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:44.742356 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:44.742837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:44.871476 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:44.879765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-35657591-2938-40c4-b48b-8a2c77e07304 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.150679 May 10 14:07:44.880334 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 248/509] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:44 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:45.622965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:45.623559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.629367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.629815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.630622 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.631059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.653692 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bf0cb751-0f4e-4d0f-9f24-d98f67d6f712 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/ips" status: 200 len: 151 microversion: 2.1 time: 0.135699 May 10 14:07:45.654260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 262/510] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:07:45 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/ips => generated 151 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:45.666583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237f405e-2510-464b-8ebf-f781162fa7b1"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:45.667704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.673613 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.674063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.674863 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.675304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.750972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: POST /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/os-volume_attachments HTTP/1.1 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 74 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:07:45.752686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {"volumeAttachment": {"volumeId": "237f405e-2510-464b-8ebf-f781162fa7b1"}} May 10 14:07:45.754240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'server_id': '73002aaf-a92d-4871-be43-ae3e119a8492', 'body': {'volumeAttachment': {'volumeId': '237f405e-2510-464b-8ebf-f781162fa7b1'}}} May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:45.755097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:45.756599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 400 to user: Invalid volume: volume 237f405e-2510-464b-8ebf-f781162fa7b1 is already attached to instances: b01e464c-7bb4-4da3-b486-18b941be97b9 {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c98c61b8-89f2-4070-86af-665b7bc9efb0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091541 May 10 14:07:45.758106 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 249/511] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:07:45 2022] POST /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:07:45.762951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:45.763454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.769797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.770273 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.771040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.771477 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.796047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:07:45.867524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-76669503-5e72-4944-a81d-a167efec9342 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 204 len: 0 microversion: 2.1 time: 0.108068 May 10 14:07:45.868123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 263/512] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:07:45 2022] DELETE /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:07:45.877229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:45.877845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.884483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.884939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.885719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.886166 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.897910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:45.898266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:45.904260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.904741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:45.905504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:45.906550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:46.021018 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:46.028511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-87dc050f-9207-4ed8-ab2b-2e336bbc51d3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1682 microversion: 2.1 time: 0.155834 May 10 14:07:46.029647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 250/513] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:45 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:46.041362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:46.049795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1214a15a-9ee0-42bb-964c-e2453583870c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.156337 May 10 14:07:46.050314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 264/514] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:45 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:47.046770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:47.047523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:47.053844 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.054317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.055069 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.055499 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.067363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:47.068015 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:47.074304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.074760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.075529 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:47.075967 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:47.186513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:47.194981 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3fd0c6a4-6534-4d55-a8e8-d185c50caac2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1682 microversion: 2.1 time: 0.152356 May 10 14:07:47.195549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 251/515] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:47 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:47.208436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:47.216093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e0cc9aa2-767b-4d53-98de-494927aca515 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.152614 May 10 14:07:47.216649 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 265/516] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:47 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:48.212634 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:48.213432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:48.220510 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.220968 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.221853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.222329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.232842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:48.234160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:48.242732 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.243464 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.244462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.245835 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.322840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:48.334322 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a7088e8e-a86e-41df-a12a-04ae99d6d4c6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 200 len: 1615 microversion: 2.1 time: 0.125207 May 10 14:07:48.336458 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 252/517] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:48 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 1615 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:48.404859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:48.415144 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a3aaf32b-a1c5-4751-9fd2-17232c9ef8c8 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.186111 May 10 14:07:48.416043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 266/518] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:48 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:48.664187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-e66139cf-f775-4871-9b25-d5acc6eefea5 req-79d5ab83-1fce-4900-8303-9a50397c7371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73002aaf-a92d-4871-be43-ae3e119a8492", "name": "network-vif-deleted", "tag": "2b916a17-cd0b-44b0-98d1-77ec3e3cee35"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:48.676365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e66139cf-f775-4871-9b25-d5acc6eefea5 req-79d5ab83-1fce-4900-8303-9a50397c7371 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:48.677134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e66139cf-f775-4871-9b25-d5acc6eefea5 req-79d5ab83-1fce-4900-8303-9a50397c7371 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:48.692246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-e66139cf-f775-4871-9b25-d5acc6eefea5 req-79d5ab83-1fce-4900-8303-9a50397c7371 service nova] Creating event network-vif-deleted:2b916a17-cd0b-44b0-98d1-77ec3e3cee35 for instance 73002aaf-a92d-4871-be43-ae3e119a8492 on hv-cinder-83588 May 10 14:07:48.698023 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-e66139cf-f775-4871-9b25-d5acc6eefea5 req-79d5ab83-1fce-4900-8303-9a50397c7371 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129364 May 10 14:07:48.703434 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 253/519] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:49.351559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:49.352377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:49.359559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:49.360337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.361296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:49.361769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.377584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 HTTP/1.1 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:07:49.379651 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:07:49.381207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '73002aaf-a92d-4871-be43-ae3e119a8492'} May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:49.382087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:07:49.383498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:49.385516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:49.386391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3607e709-504c-48e0-8541-38d06dc58090 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 404 len: 111 microversion: 2.1 time: 0.038791 May 10 14:07:49.386952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 267/520] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:49 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:07:49.396677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1d4141da-a25d-49c6-9b1b-114f38f47468 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '.version_select at 0x7efd562e2160>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:49.421971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1d4141da-a25d-49c6-9b1b-114f38f47468 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644428312" status: 202 len: 0 microversion: 2.1 time: 0.028715 May 10 14:07:49.423566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 254/521] 10.222.0.32 () {58 vars in 1220 bytes} [Tue May 10 14:07:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644428312 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:49.433424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:49.434418 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:49.443591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:49.444268 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.445317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:49.446017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:49.643457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:49.658573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d623ec71-d402-41e4-aadb-988cbfea7f5a tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.228831 May 10 14:07:49.668324 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 268/522] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:49 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:50.212812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:50.213448 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:50.220349 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.220808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.221592 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.222034 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.308310 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lazy-loading 'services' on Instance uuid b01e464c-7bb4-4da3-b486-18b941be97b9 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:07:50.379113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a86ad393-93a5-44ad-954b-99f2171c1154 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments/237f405e-2510-464b-8ebf-f781162fa7b1" status: 202 len: 0 microversion: 2.1 time: 0.170220 May 10 14:07:50.380181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 255/523] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:07:50 2022] DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments/237f405e-2510-464b-8ebf-f781162fa7b1 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:50.389616 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:50.391350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:50.398310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.399004 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.400122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.400681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.434785 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b84591ea-2a6f-4122-967f-0b22ae562163 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050111 May 10 14:07:50.435396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 269/524] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:07:50 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:07:50.677484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:50.678117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:50.684992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.685449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.686251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:50.686702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:50.826059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:50.834332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d4b43ebe-7231-48cb-b4ff-1e53f6457182 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.161224 May 10 14:07:50.834905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 256/525] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:50 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:51.447591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:51.448535 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:51.455829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.456278 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.457057 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.457491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.487752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6e0bfb53-2f70-4983-b670-e2fffac2e4dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 May 10 14:07:51.488336 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 270/526] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:07:51 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:51.852296 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:51.852914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:51.859571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.860026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.860832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:51.861269 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:51.988885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:51.997173 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-07ef5882-8ce2-4b7e-9016-21d8e73e66cd tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.148889 May 10 14:07:51.998059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 257/527] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:51 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:52.500385 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:52.501302 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:52.507574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:52.508016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:52.508784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:52.509220 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:52.536906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a1ec481c-0da5-4db1-ba68-5dd7f377075c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041465 May 10 14:07:52.537454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 271/528] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:07:52 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:53.014100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:53.014743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:53.021363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.021827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.022628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.023069 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.152131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:53.160955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ec52140e-b61e-4ff3-9d24-de9a2717350c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.150682 May 10 14:07:53.161524 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 258/529] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:53 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:53.548942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:53.549776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:53.556052 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.556502 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.557262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.557690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.586456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f1ec48a3-343e-4959-b372-aef198b2a5ed tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041741 May 10 14:07:53.587002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 272/530] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:07:53 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:07:53.646497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:53.646993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:53.652941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.653393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.654155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.654618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.679177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:07:53.753976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7c996429-3b98-4e37-90d2-a117accda3bf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 204 len: 0 microversion: 2.1 time: 0.110875 May 10 14:07:53.754637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 259/531] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:07:53 2022] DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:07:53.762746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:53.763362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:53.770016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.770499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.771274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:53.771707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:53.903208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:53.911010 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-00f5ac28-12b0-4d17-8c87-12dccc3f9637 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1681 microversion: 2.1 time: 0.152080 May 10 14:07:53.911571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 273/532] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:53 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:54.178262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:54.179675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:54.186065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.186544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:54.187985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.188544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:54.317149 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:54.324934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-30400d27-cc70-477e-9fa3-0bffc0ab3be7 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1737 microversion: 2.1 time: 0.150890 May 10 14:07:54.325492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 260/533] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:54 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:54.927961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:54.928566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:54.935080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.935574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:54.936322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:54.936787 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.064990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:55.075990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6ecbcd78-bba0-4a72-bb7c-810fd9ee113f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1681 microversion: 2.1 time: 0.151792 May 10 14:07:55.087665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 274/534] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:54 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:55.342230 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:55.342853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:55.349287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.349745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.350566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.351012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.573860 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:55.582954 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-55d11106-c0ec-4934-9e39-23e6a082029e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1717 microversion: 2.1 time: 0.244848 May 10 14:07:55.583768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 261/535] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:55 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1717 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:55.638005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:55.638684 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:55.645126 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.645663 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.646563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.647075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.730963 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] HTTP exception thrown: Cannot 'detach_volume' instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd while it is in vm_state rescued May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Request method failure captured: May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments/1f7569fb-5a56-485c-9c96-3db24293a793 HTTP/1.1 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIg0Kt1vEsK0v55lcfihVciib-NJkhVshJVV6NMx8ilUp4B4YfQ3KwbQUxwb-DsrIzWDBZfjdva7wvnq74azHqHwO7Ri-IZ5oENA7fNKssFN6ySubXbUIuPp1B1jOfDl4oUWR3pF8q59CWKnAQsV2rlXWNx0sT495AlBPjNysBm2g May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:07:55.732508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_523029c9401f49c399be46bfe308b5e6", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1897b88622664ceca4deac5a22079726 May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:07:55.734279 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Cannot 'detach_volume' instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd while it is in vm_state rescued May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'server_id': '05c96bfa-9abc-4b43-a1fc-e9b75d8436cd', 'id': '1f7569fb-5a56-485c-9c96-3db24293a793'} May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:55.735000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd while it is in vm_state rescued May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd while it is in vm_state rescued May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:07:55.736225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Returning 409 to user: Cannot 'detach_volume' instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd while it is in vm_state rescued {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:55.737187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-daf0b2aa-62c3-4a2e-ad00-9d4e3d19f240 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments/1f7569fb-5a56-485c-9c96-3db24293a793" status: 409 len: 152 microversion: 2.1 time: 0.100279 May 10 14:07:55.737187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 275/536] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:07:55 2022] DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments/1f7569fb-5a56-485c-9c96-3db24293a793 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 14:07:55.743296 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:55.743842 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:55.751099 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.751555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.752340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.752778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.822252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c08f49f0-72ec-48b0-a4b4-5dbf81502292 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/action" status: 202 len: 0 microversion: 2.1 time: 0.082623 May 10 14:07:55.825962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 262/537] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:07:55 2022] POST /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:55.835773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:55.836496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:55.849646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.850427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:55.851457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:55.852138 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.004398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:56.013273 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9b984c32-5344-4ac8-8c46-451142275ad1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1725 microversion: 2.1 time: 0.181567 May 10 14:07:56.014003 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 276/538] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:55 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:56.097695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:56.098656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:56.105223 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:56.105692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.106573 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:56.107156 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.158410 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-88622f0f-de46-4791-95bf-576d04a44a73 req-30dd24e6-4602-4e5a-bfbf-71fe3c48a4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01e464c-7bb4-4da3-b486-18b941be97b9", "name": "network-vif-deleted", "tag": "16a28325-933e-48f7-9d78-2defa48a5ac0"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:56.177237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-88622f0f-de46-4791-95bf-576d04a44a73 req-30dd24e6-4602-4e5a-bfbf-71fe3c48a4e2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:56.178569 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-88622f0f-de46-4791-95bf-576d04a44a73 req-30dd24e6-4602-4e5a-bfbf-71fe3c48a4e2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:56.193178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-88622f0f-de46-4791-95bf-576d04a44a73 req-30dd24e6-4602-4e5a-bfbf-71fe3c48a4e2 service nova] Creating event network-vif-deleted:16a28325-933e-48f7-9d78-2defa48a5ac0 for instance b01e464c-7bb4-4da3-b486-18b941be97b9 on hv-cinder-83588 May 10 14:07:56.198033 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:56.201926 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-88622f0f-de46-4791-95bf-576d04a44a73 req-30dd24e6-4602-4e5a-bfbf-71fe3c48a4e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046486 May 10 14:07:56.202989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 277/539] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:07:56.211333 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-07c4a721-f232-441b-b10b-fad353dbc98d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 200 len: 1614 microversion: 2.1 time: 0.118088 May 10 14:07:56.226548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 263/540] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:56 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:57.033903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:57.034657 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:57.043371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.044317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.045221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.045765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.182020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:57.192117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5548608f-6572-4393-a43b-671162f2e346 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1725 microversion: 2.1 time: 0.164059 May 10 14:07:57.192697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 278/541] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:57 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:57.229520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:57.230386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:57.238056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.238689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.239600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:57.240114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:57.256994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 HTTP/1.1 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:07:57.258877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:07:57.260169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'b01e464c-7bb4-4da3-b486-18b941be97b9'} May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:07:57.261125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:07:57.262470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:07:57.263532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:07:57.263532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4fe5d9b3-c52b-4bfa-9527-1498bbabac28 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 404 len: 111 microversion: 2.1 time: 0.034845 May 10 14:07:57.263532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 264/542] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:57 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:07:57.269272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ce507e6f-1d6b-4cfa-9b88-ed5188791545 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '.version_select at 0x7efd56399af0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:57.289461 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ce507e6f-1d6b-4cfa-9b88-ed5188791545 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-766251379" status: 202 len: 0 microversion: 2.1 time: 0.024097 May 10 14:07:57.290034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 279/543] 10.222.0.32 () {58 vars in 1217 bytes} [Tue May 10 14:07:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-766251379 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:07:57.917132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-04e763de-dfb0-4dae-a345-faa5ec0c46f9 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: .version_select at 0x7efd562f59d0>, body: {"keypair": {"name": "tempest-keypair-2035504962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKc4sPyE1Tx9LXndik95VT/pw96Pu889CnYzI3wcZ3NcK9H7T4PdkTffRk7s9j2GRaXeil3OFjMijgGJsbo6B6tyxGu/MNIycSpRNMFhuc5chqdRe4LBjUlvyrxOcRfghQ=="}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:57.930872 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-04e763de-dfb0-4dae-a345-faa5ec0c46f9 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:07:57.934578 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-04e763de-dfb0-4dae-a345-faa5ec0c46f9 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:07:57.956347 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-04e763de-dfb0-4dae-a345-faa5ec0c46f9 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043078 May 10 14:07:57.956963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 265/544] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:07:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:58.210705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:58.211331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:58.218224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:58.218971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:58.219761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:58.220205 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:58.391551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:58.402903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8e2820b5-3c71-48e0-8022-dd58b7fcbe58 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1725 microversion: 2.1 time: 0.196559 May 10 14:07:58.403476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 280/545] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:58 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:07:59.244445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-465857479", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c07cd0-6152-43ba-84e4-0ef3e3d224df"}], "security_groups": [{"name": "tempest-securitygroup--47810697"}], "key_name": "tempest-keypair-2035504962", "user_data": "}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:07:59.344833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] validate_networks() for [('49c07cd0-6152-43ba-84e4-0ef3e3d224df', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:07:59.420067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:59.420601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:59.427404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.428195 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.429535 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.430656 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.566277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:07:59.574360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-24982e53-0495-47cc-b44e-5ce416bdb29e tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1731 microversion: 2.1 time: 0.158190 May 10 14:07:59.575045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 281/546] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:07:59 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:07:59.591725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:07:59.592267 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:07:59.599243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.599706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.600480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.600925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.682214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dc02fddd-1a8b-4c52-b77e-db5060b9c475 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094228 May 10 14:07:59.682896 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 282/547] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:07:59 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:07:59.809663 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:07:59.810148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:07:59.810678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:07:59.811093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:07:59.811537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:07:59.820078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.820533 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.821341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:07:59.821783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:07:59.838288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:07:59.842244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:07:59.854065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:07:59.856915 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:07:59.901797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR oslo.messaging._drivers.impl_rabbit [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [63b8fb17-6bb0-4661-acc0-d4f58d16f09d] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 14:08:00.878940 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-23fd4bdd-213f-4601-8fca-b556dfb52b37 req-3108e5d6-c42b-4c29-a886-2b19cdc8a484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:00.886900 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-23fd4bdd-213f-4601-8fca-b556dfb52b37 req-3108e5d6-c42b-4c29-a886-2b19cdc8a484 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:00.887421 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-23fd4bdd-213f-4601-8fca-b556dfb52b37 req-3108e5d6-c42b-4c29-a886-2b19cdc8a484 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:00.899583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-23fd4bdd-213f-4601-8fca-b556dfb52b37 req-3108e5d6-c42b-4c29-a886-2b19cdc8a484 service nova] Creating event network-changed:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:08:00.905017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-23fd4bdd-213f-4601-8fca-b556dfb52b37 req-3108e5d6-c42b-4c29-a886-2b19cdc8a484 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089192 May 10 14:08:00.906509 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 283/548] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:08:00.912016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [63b8fb17-6bb0-4661-acc0-d4f58d16f09d] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 56746. May 10 14:08:00.916910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-864f576a-398c-46ea-a6f6-c9f3efecf855 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.677288 May 10 14:08:00.918066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 266/549] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:07:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 1679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:08:00.932856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1d4821c1-2753-4364-b946-0d38080c5602 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:00.933953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1d4821c1-2753-4364-b946-0d38080c5602 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:00.990484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1d4821c1-2753-4364-b946-0d38080c5602 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:00.997543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1d4821c1-2753-4364-b946-0d38080c5602 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1241 microversion: 2.1 time: 0.071030 May 10 14:08:00.998112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 284/550] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:00 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:02.015251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-44168e57-3e6d-4395-b275-4a63f4648a60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:02.015973 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-44168e57-3e6d-4395-b275-4a63f4648a60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:02.069076 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-44168e57-3e6d-4395-b275-4a63f4648a60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:02.075736 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-44168e57-3e6d-4395-b275-4a63f4648a60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1241 microversion: 2.1 time: 0.064898 May 10 14:08:02.076332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 267/551] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:02 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:02.920158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-d02b012c-24ab-4f76-a24f-f090c721305b req-2ea790fe-54b4-4e86-86e2-7514bf1f4c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:02.930338 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d02b012c-24ab-4f76-a24f-f090c721305b req-2ea790fe-54b4-4e86-86e2-7514bf1f4c0d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:02.930789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d02b012c-24ab-4f76-a24f-f090c721305b req-2ea790fe-54b4-4e86-86e2-7514bf1f4c0d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:02.941928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-d02b012c-24ab-4f76-a24f-f090c721305b req-2ea790fe-54b4-4e86-86e2-7514bf1f4c0d service nova] Creating event network-changed:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:08:02.946664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-d02b012c-24ab-4f76-a24f-f090c721305b req-2ea790fe-54b4-4e86-86e2-7514bf1f4c0d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030138 May 10 14:08:02.947310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 285/552] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:03.092633 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-aa0d58b0-4495-4e17-a2ec-f76a50d34666 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:03.093290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-aa0d58b0-4495-4e17-a2ec-f76a50d34666 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:03.178333 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aa0d58b0-4495-4e17-a2ec-f76a50d34666 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:03.185027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-aa0d58b0-4495-4e17-a2ec-f76a50d34666 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1241 microversion: 2.1 time: 0.096472 May 10 14:08:03.194868 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 268/553] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:03 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:03.888244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:03.888831 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:03.895695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:03.896151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:03.896921 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:03.897362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:03.975293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lazy-loading 'services' on Instance uuid de2d918d-8df2-4251-a1e8-c73cb0c946c1 {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:08:04.045073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-24b60c48-3d5a-4666-982c-fc91cab34951 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments/a06314c9-9674-46bf-a740-59619fc646df" status: 202 len: 0 microversion: 2.1 time: 0.161046 May 10 14:08:04.045672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 286/554] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:08:03 2022] DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments/a06314c9-9674-46bf-a740-59619fc646df => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:08:04.202053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9a8e26bd-1213-4844-8078-7837a352c6d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:04.203249 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9a8e26bd-1213-4844-8078-7837a352c6d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:04.254923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9a8e26bd-1213-4844-8078-7837a352c6d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:04.261375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9a8e26bd-1213-4844-8078-7837a352c6d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1241 microversion: 2.1 time: 0.063138 May 10 14:08:04.262180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 269/555] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:04 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1241 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:05.157621 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-62f6afc5-4130-4a82-b942-e618adc67a9d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:05.163780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-62f6afc5-4130-4a82-b942-e618adc67a9d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.164234 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-62f6afc5-4130-4a82-b942-e618adc67a9d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.185262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-62f6afc5-4130-4a82-b942-e618adc67a9d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Going to try to stop instance {{(pid=117186) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 14:08:05.226159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-62f6afc5-4130-4a82-b942-e618adc67a9d tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action" status: 202 len: 0 microversion: 2.1 time: 0.073699 May 10 14:08:05.226839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 287/556] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:08:05 2022] POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:08:05.234940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:05.235554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:05.243216 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.243736 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.245419 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.246508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.279214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:05.279911 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:05.286857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.287311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.288082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:05.288517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:05.358076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:05.366148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4bef5589-6e75-412b-8f0d-1c63f586fdf6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1245 microversion: 2.1 time: 0.091103 May 10 14:08:05.366766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 288/557] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:05 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:05.386580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:05.394777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-490f2566-65b4-4b5d-b34a-f2db3121230e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.163839 May 10 14:08:05.395336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 270/558] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:05 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:06.383415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:06.384128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:06.391245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.391705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.392517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.392959 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.411054 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:06.411667 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:06.418621 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.419079 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.419858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:06.420297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:06.455426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:06.463112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a3bd1b95-1f99-4ff8-963b-387ca8ff4618 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1299 microversion: 2.1 time: 0.083684 May 10 14:08:06.463785 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 289/559] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:06 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:06.623227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:06.631006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ba0cc798-1642-42d1-8b76-6119cdc52728 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.223775 May 10 14:08:06.631574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 271/560] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:06 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:07.434114 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-67ca1066-2201-4325-82a3-265baefcc3c2 req-c834f758-5908-4be0-a0f3-5ee530df6f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a09a513-e43b-4233-a490-2041140d9dca", "tag": "1277ce7c-0191-40fb-998f-f307d1835a4d"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:07.446901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-67ca1066-2201-4325-82a3-265baefcc3c2 req-c834f758-5908-4be0-a0f3-5ee530df6f7e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.447353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-67ca1066-2201-4325-82a3-265baefcc3c2 req-c834f758-5908-4be0-a0f3-5ee530df6f7e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.461937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-67ca1066-2201-4325-82a3-265baefcc3c2 req-c834f758-5908-4be0-a0f3-5ee530df6f7e service nova] Creating event network-changed:1277ce7c-0191-40fb-998f-f307d1835a4d for instance 8a09a513-e43b-4233-a490-2041140d9dca on hv-cinder-83588 May 10 14:08:07.482973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-67ca1066-2201-4325-82a3-265baefcc3c2 req-c834f758-5908-4be0-a0f3-5ee530df6f7e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052350 May 10 14:08:07.484518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 290/561] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:07.486136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:07.487322 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:07.495050 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.495603 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.496761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.498578 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.649334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:07.650046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:07.656717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.657163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.657936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:07.658406 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:07.721482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:07.729274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f9b9fb90-80c1-4aa6-baa5-80f5b4a46848 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.251824 May 10 14:08:07.729855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 272/562] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:07 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:07.792043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:07.799991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d8e5a293-2bb4-400e-ae9d-fd8f12517ca2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.154876 May 10 14:08:07.800558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 291/563] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:07 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:08.747759 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:08.748418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:08.755029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.755482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:08.756245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.756678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:08.817485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:08.818101 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:08.824716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.825168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:08.825943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:08.826414 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:08.889575 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:08.898238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3efd6a56-a79f-4803-8229-f166121d6672 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.155166 May 10 14:08:08.899138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 273/564] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:08 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:08.961668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:08.969035 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9c774a8a-29a2-470f-8b94-4d9a231e8520 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.155465 May 10 14:08:08.969601 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 292/565] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:08 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:09.915113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:09.915732 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:09.922776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:09.923237 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:09.924020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:09.924466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:09.986033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:09.986685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:09.993121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:09.993571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:09.994373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:09.994814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:10.056968 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:10.065449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a731a7c9-16c5-45dd-8efc-54e266fb5eec tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.154340 May 10 14:08:10.066039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 274/566] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:09 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:10.126283 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:10.133857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-36adf88b-6161-458b-af74-c0fe22a1ac58 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.151850 May 10 14:08:10.134454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 293/567] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:09 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:11.082234 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:11.082891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:11.089249 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:11.089705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:11.090520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:11.090962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:11.151792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:11.152411 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:11.160155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:11.160605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:11.161392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:11.161828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:11.295627 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:11.303901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6ea90896-a33e-4c8f-b195-edc5c6c0f60c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.155915 May 10 14:08:11.304494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 294/568] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:11 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:11.466130 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:11.474040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-39c458ad-984d-499f-9864-53c9e5bd8df3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.395678 May 10 14:08:11.474635 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 275/569] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:11 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:12.321396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:12.321930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:12.329091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:12.329550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:12.330348 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:12.330793 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:12.465989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:12.473431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e057f00a-3922-4fee-b15d-92ea7b1e3d4f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.156043 May 10 14:08:12.474006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 295/570] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:12 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:12.490790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:12.491410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:12.497949 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:12.498441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:12.500057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:12.500510 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:12.603171 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-a2718ea4-b189-4185-b082-8e32a2dbd861 req-644b18f9-3052-463d-9cef-395b11c9cf93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a09a513-e43b-4233-a490-2041140d9dca", "name": "network-vif-plugged", "status": "completed", "tag": "1277ce7c-0191-40fb-998f-f307d1835a4d"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:12.611950 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a2718ea4-b189-4185-b082-8e32a2dbd861 req-644b18f9-3052-463d-9cef-395b11c9cf93 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:12.612401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a2718ea4-b189-4185-b082-8e32a2dbd861 req-644b18f9-3052-463d-9cef-395b11c9cf93 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:12.623361 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-a2718ea4-b189-4185-b082-8e32a2dbd861 req-644b18f9-3052-463d-9cef-395b11c9cf93 service nova] Creating event network-vif-plugged:1277ce7c-0191-40fb-998f-f307d1835a4d for instance 8a09a513-e43b-4233-a490-2041140d9dca on hv-cinder-83588 May 10 14:08:12.629328 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-a2718ea4-b189-4185-b082-8e32a2dbd861 req-644b18f9-3052-463d-9cef-395b11c9cf93 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095267 May 10 14:08:12.629915 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 296/571] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:08:12.639231 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:12.647803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3f2e4f26-843d-4fa4-a3e5-a3470af60c59 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.160807 May 10 14:08:12.648382 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 276/572] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:12 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:08:13.491482 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:13.492213 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:13.498613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:13.499067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:13.499831 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:13.500265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:13.626327 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:13.633632 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3ee298de-6e50-4e73-9924-3a0f7ffa4b59 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.146810 May 10 14:08:13.634244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 297/573] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:13 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:13.664711 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:13.665320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:13.671681 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:13.672130 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:13.672895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:13.673333 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:13.797599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:13.805026 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-204bf639-f31b-4a12-89d6-0c3b772d2d03 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1365 microversion: 2.1 time: 0.144169 May 10 14:08:13.805588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 277/574] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:13 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:14.651265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:14.651883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:14.659015 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.659475 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:14.660249 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.660695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:14.804649 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:14.812053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b4238aa9-9542-4dca-9b47-97f0534792de tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1676 microversion: 2.1 time: 0.164679 May 10 14:08:14.812625 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 298/575] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:14 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:14.822078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:14.822720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:14.829087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.829532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:14.830329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.830763 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:14.958835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:14.966085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dc946339-5d16-4e96-b7b5-f87a3f220d60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1555 microversion: 2.1 time: 0.147812 May 10 14:08:14.966731 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 278/576] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:14 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:14.982836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:14.983337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:14.989165 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.989609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:14.990398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:14.990828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:15.066173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-20dbb10b-3700-4329-bb4f-23c4b99bd713 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087250 May 10 14:08:15.066797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 299/577] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:08:14 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:15.829991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:15.830568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:15.836977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:15.837432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:15.838224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:15.838674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:15.965090 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:15.973128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-13ca1ed4-feb4-4243-ba26-c299fd0aeed9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1653 microversion: 2.1 time: 0.147652 May 10 14:08:15.973702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 279/578] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:15 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1653 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:15.990907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9af88cab-4aaf-4321-add5-604159f22d7a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:15.997263 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9af88cab-4aaf-4321-add5-604159f22d7a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:15.998265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9af88cab-4aaf-4321-add5-604159f22d7a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:16.021743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9af88cab-4aaf-4321-add5-604159f22d7a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Going to try to start instance {{(pid=117186) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 14:08:16.040007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-9d0c2b02-2bad-4d24-a664-3bf7d5660bb3 req-9ee452d9-bb60-436d-a425-53330ec875ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a09a513-e43b-4233-a490-2041140d9dca", "tag": "1277ce7c-0191-40fb-998f-f307d1835a4d"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:16.048665 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-9d0c2b02-2bad-4d24-a664-3bf7d5660bb3 req-9ee452d9-bb60-436d-a425-53330ec875ca service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:16.049334 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-9d0c2b02-2bad-4d24-a664-3bf7d5660bb3 req-9ee452d9-bb60-436d-a425-53330ec875ca service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:16.061564 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-9d0c2b02-2bad-4d24-a664-3bf7d5660bb3 req-9ee452d9-bb60-436d-a425-53330ec875ca service nova] Creating event network-changed:1277ce7c-0191-40fb-998f-f307d1835a4d for instance 8a09a513-e43b-4233-a490-2041140d9dca on hv-cinder-83588 May 10 14:08:16.068143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-9d0c2b02-2bad-4d24-a664-3bf7d5660bb3 req-9ee452d9-bb60-436d-a425-53330ec875ca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031483 May 10 14:08:16.069441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 280/579] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:16.070021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9af88cab-4aaf-4321-add5-604159f22d7a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action" status: 202 len: 0 microversion: 2.1 time: 0.082766 May 10 14:08:16.074611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 300/580] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:08:15 2022] POST /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:08:16.080955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:16.081586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:16.087886 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:16.088342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:16.089114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:16.089546 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:16.382416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:16.390959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9b5f83f0-4379-4d37-97b6-1c79f634c03e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1662 microversion: 2.1 time: 0.314894 May 10 14:08:16.400872 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 281/581] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:16 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1662 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:17.409370 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:17.410311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:17.417002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:17.417454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:17.418445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:17.418893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:17.554387 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:17.564573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b60c45f4-49fb-4c79-88c3-882ddc0a94e9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1662 microversion: 2.1 time: 0.160121 May 10 14:08:17.565161 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 301/582] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:17 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1662 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:18.582526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:18.583079 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:18.589424 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:18.589869 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:18.590647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:18.591081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:18.715513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:18.722976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-da314db5-5b33-4b72-aa30-7d4875fa4e0f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1666 microversion: 2.1 time: 0.145179 May 10 14:08:18.723611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 282/583] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:18 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1666 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:27.054827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:27.055442 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:27.061897 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:27.062387 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:27.063184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:27.063659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:27.086311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lazy-loading 'flavor' on Instance uuid 6890fa7d-7922-4684-84e7-9dba0e4e6329 {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:08:27.158253 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c337292f-3d11-451c-8022-f915546fee59 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "POST /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329/action" status: 202 len: 0 microversion: 2.1 time: 0.107101 May 10 14:08:27.158749 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 302/584] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:08:27 2022] POST /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:08:27.166788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:27.167396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:27.173906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:27.174379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:27.175151 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:27.175583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:27.304245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:27.311571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9f28da51-1f15-4577-a6eb-259aec454488 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.148528 May 10 14:08:27.312137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 283/585] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:27 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:28.332240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:28.332955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:28.339103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:28.339550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:28.340305 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:28.340735 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:28.475677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:28.483168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-45d6dada-db22-40eb-9d11-140f38e4c692 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.156237 May 10 14:08:28.483743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 303/586] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:28 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:29.506964 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:29.507582 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:29.513934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:29.514431 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:29.515209 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:29.515651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:29.645861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:29.653148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a861622c-4c96-4d6f-bb67-40e66ee2026d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.150161 May 10 14:08:29.653712 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 284/587] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:29 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:30.670478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:30.671090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:30.678074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:30.678615 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:30.679373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:30.679803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:30.805949 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:30.813878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e9098d01-606f-4579-bc6e-2f96abf318f8 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.146658 May 10 14:08:30.814473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 304/588] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:30 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:31.831507 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:31.832126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:31.838592 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:31.839048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:31.839825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:31.840263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:31.967583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:31.975271 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-aee711b3-76f2-4d0b-9ce0-5d32d014474d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.148288 May 10 14:08:31.975857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 285/589] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:31 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:32.992681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:32.993293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:32.999871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:33.000386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:33.001315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:33.001754 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:33.130946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:33.138563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1fc9fe79-784c-4066-ac68-875c53331044 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.149793 May 10 14:08:33.139136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 305/590] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:32 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:34.155585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:34.156116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:34.163413 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:34.163868 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:34.164648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:34.165089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:34.357111 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:34.366167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6c87447f-72b7-479e-b573-054d7fa418ef tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.214585 May 10 14:08:34.366764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 286/591] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:34 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:35.384302 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:35.384908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:35.391634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:35.392081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:35.392844 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:35.393272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:35.520350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:35.527658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2f640835-c78c-4e42-be7d-c07d06e84a43 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.147318 May 10 14:08:35.528239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 306/592] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:35 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:36.544987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:36.545603 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:36.552383 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:36.552840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:36.553615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:36.554058 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:36.687055 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:36.695466 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-eadb1866-196d-46a5-bf1e-d8f0a61b6be7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.154273 May 10 14:08:36.696054 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 287/593] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:36 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:37.712703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:37.713345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:37.720580 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:37.720968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:37.721764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:37.722215 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:37.857167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:37.864977 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5b302f5d-1068-4181-b182-0e78e32d13cc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.156238 May 10 14:08:37.865759 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 307/594] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:37 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:38.882633 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:38.883254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:38.889184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:38.889642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:38.890474 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:38.890992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:39.017924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:39.025349 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-97d0bec0-4fd8-417e-98ca-7c79742d4a8b tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.146773 May 10 14:08:39.025912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 288/595] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:38 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:40.042880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:40.043519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:40.050561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:40.051023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:40.051803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:40.052245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:40.191119 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:40.198689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dd86c90e-d2f8-4bb5-8d34-f19e009b3dfe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.159594 May 10 14:08:40.199272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 308/596] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:40 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:41.217852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:41.218437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:41.225463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.225912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.226701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.227137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.358446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:41.365825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-957c3674-bdc9-462e-b353-e161b5eca2b2 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1508 microversion: 2.1 time: 0.151964 May 10 14:08:41.366410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 289/597] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:41 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:41.382617 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:41.383293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:41.389152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.389628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.390420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.390859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.527600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3de6a5ef-ddd2-491b-825e-fd4c2e754994 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "POST /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329/action" status: 202 len: 0 microversion: 2.1 time: 0.148657 May 10 14:08:41.528218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 309/598] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:08:41 2022] POST /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:08:41.536562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:41.537184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:41.543075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.543536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.544310 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:41.544757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:41.684778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:41.692936 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-222e5ca0-f009-4902-8057-17c4c78df7c1 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1516 microversion: 2.1 time: 0.160502 May 10 14:08:41.693519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 290/599] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:41 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:42.593473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-83b54bce-89ba-4bfb-b686-5fd732d9bab5 req-46f2f4ae-0247-45dc-8b7a-e6d94802a418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "name": "network-vif-unplugged", "status": "completed", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:42.604558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-83b54bce-89ba-4bfb-b686-5fd732d9bab5 req-46f2f4ae-0247-45dc-8b7a-e6d94802a418 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:42.605181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-83b54bce-89ba-4bfb-b686-5fd732d9bab5 req-46f2f4ae-0247-45dc-8b7a-e6d94802a418 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:42.616312 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.compute.server_external_events [req-83b54bce-89ba-4bfb-b686-5fd732d9bab5 req-46f2f4ae-0247-45dc-8b7a-e6d94802a418 service nova] Unable to find a host for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329. Dropping event network-vif-unplugged {{(pid=117186) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 14:08:42.617181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-83b54bce-89ba-4bfb-b686-5fd732d9bab5 req-46f2f4ae-0247-45dc-8b7a-e6d94802a418 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027742 May 10 14:08:42.617929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 310/600] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 14:08:42.710820 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:42.711435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:42.718095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:42.718580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:42.719558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:42.720626 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:42.864001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:42.872287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c1e9ed1f-854a-4b97-9708-218f7c18b3bc tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1518 microversion: 2.1 time: 0.165015 May 10 14:08:42.873210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 291/601] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:42 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:43.890469 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:43.891163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:43.898393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:43.898848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:43.899664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:43.900099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:44.033520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:44.041934 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1ca1378e-0c36-41fa-809d-dcc862a9d996 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.155366 May 10 14:08:44.042554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 311/602] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:43 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:45.058530 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:45.059142 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:45.066325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:45.066766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:45.067537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:45.067977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:45.197516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:45.205533 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-932cc7f3-e997-4096-8334-30eb9463ffc4 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.150828 May 10 14:08:45.206107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 292/603] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:45 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:46.222278 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:46.222806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:46.229175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:46.229631 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:46.230455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:46.230899 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:46.360147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:46.367985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-01d81a21-681b-4bb3-8182-7c3d8c2db1fe tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.150538 May 10 14:08:46.368558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 312/604] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:46 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:47.384782 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:47.385400 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:47.392480 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:47.392937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:47.393713 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:47.394158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:47.521777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:47.529094 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f5e7c2f5-4d6b-4e03-b5d9-e4ff81270866 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.148201 May 10 14:08:47.529666 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 293/605] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:47 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:48.546581 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:48.547190 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:48.554176 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:48.554652 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:48.555406 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:48.555836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:48.681628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:48.690022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-32f0d750-eaa6-4be0-ab96-0b8d5e496b73 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.147398 May 10 14:08:48.690653 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 313/606] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:48 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:49.707489 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:49.708102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:49.714457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:49.714912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:49.715799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:49.716252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:49.846602 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:49.854126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1162de80-4ce4-4e78-a2f4-ca65a98cf627 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.150494 May 10 14:08:49.854750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 294/607] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:49 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:50.871658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:50.872532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:50.879603 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:50.880059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:50.880824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:50.881263 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:51.012168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:51.019436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bb613555-156d-4ae0-bf3e-6e65fff3b75c tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.151667 May 10 14:08:51.019999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 314/608] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:50 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:52.036417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:52.037028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:52.043445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:52.043923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:52.044692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:52.045214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:52.175985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:52.183359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9b5c482e-36a8-481e-8065-3b9a3eccefa6 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.150716 May 10 14:08:52.183941 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 295/609] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:52 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:53.200708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:53.201244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:53.207603 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:53.208058 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:53.208869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:53.209302 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:53.338917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:53.346833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-77e3b89a-bf4b-4334-a860-4e918f5c164d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.150128 May 10 14:08:53.347405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 315/610] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:53 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:54.364323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:54.364958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:54.371489 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:54.372185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:54.372966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:54.373407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:54.504983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:54.512325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-aecfcc94-88bc-4ed5-ab48-bc7d9bcf493d tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.152575 May 10 14:08:54.512905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 296/611] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:54 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:54.629995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-a9044165-5f90-4846-9bfc-7be9e04d7782 req-63d9e456-4223-4b8a-8f44-b9b92e65918f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "name": "network-vif-plugged", "status": "completed", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:08:54.638586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a9044165-5f90-4846-9bfc-7be9e04d7782 req-63d9e456-4223-4b8a-8f44-b9b92e65918f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:54.639037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a9044165-5f90-4846-9bfc-7be9e04d7782 req-63d9e456-4223-4b8a-8f44-b9b92e65918f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:54.650038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-a9044165-5f90-4846-9bfc-7be9e04d7782 req-63d9e456-4223-4b8a-8f44-b9b92e65918f service nova] Creating event network-vif-plugged:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:08:54.655120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-a9044165-5f90-4846-9bfc-7be9e04d7782 req-63d9e456-4223-4b8a-8f44-b9b92e65918f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029585 May 10 14:08:54.655743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 316/612] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:08:55.530575 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:55.531188 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:55.538081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:55.538563 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:55.539331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:55.539769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:55.666671 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:55.674714 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ce4cf8c6-c6fc-4b12-b6c3-81c1014afa32 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1574 microversion: 2.1 time: 0.148040 May 10 14:08:55.675290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 297/613] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:55 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:08:56.693276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:08:56.693975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:08:56.700167 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:56.700617 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:56.701379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:08:56.701815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:08:56.837487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:08:56.845570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e07f570b-b278-4f57-92fe-ead39960b3aa tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1561 microversion: 2.1 time: 0.156608 May 10 14:08:56.846308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 317/614] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:08:56 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:04.318451 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:04.318971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:04.325305 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.325758 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.326567 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.327005 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.406440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lazy-loading 'services' on Instance uuid 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:04.485766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3441ee4b-42fd-434d-bd80-837b0369e0f2 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments/1f7569fb-5a56-485c-9c96-3db24293a793" status: 202 len: 0 microversion: 2.1 time: 0.170984 May 10 14:09:04.486570 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 298/615] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:09:04 2022] DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments/1f7569fb-5a56-485c-9c96-3db24293a793 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:04.495592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:04.496529 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:04.504637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.505647 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.506721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:04.507174 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:04.539171 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b095e3ff-3000-46ec-92d0-69b83b542253 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047622 May 10 14:09:04.539743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 318/616] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:04 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:05.551676 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:05.552668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:05.559211 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.559732 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.560496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.560930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.590167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a08e3f59-8226-4a87-a2d6-0a0a31e0b263 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043061 May 10 14:09:05.590932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 299/617] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:05 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:09:05.662301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:05.662832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:05.669069 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.669525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.670329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.670773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.695110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:05.772581 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-db3001ea-200b-4fce-9fee-78a5b6935f45 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 204 len: 0 microversion: 2.1 time: 0.114584 May 10 14:09:05.773188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 319/618] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:09:05 2022] DELETE /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:05.782236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:05.783007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:05.788888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.789335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.790088 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:05.790545 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:05.917378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:05.925779 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3125dac3-f782-4682-9eac-4ccb00083ce1 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1691 microversion: 2.1 time: 0.147375 May 10 14:09:05.926386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 300/619] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:05 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:06.943907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:06.944611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:06.951037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:06.951488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:06.952248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:06.952685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:07.079393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:07.086791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-346382a4-82f9-4238-9f0d-89e1c670707b tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1691 microversion: 2.1 time: 0.147757 May 10 14:09:07.087351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 320/620] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:06 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:08.103637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:08.104257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:08.110468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:08.110863 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:08.111650 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:08.112538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:08.239233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:08.246599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6b53010e-12f2-4004-9d48-a148c55ad808 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1691 microversion: 2.1 time: 0.146682 May 10 14:09:08.247422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 301/621] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:08 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:09.264020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:09.264537 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:09.271558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:09.272015 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:09.272794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:09.273233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:09.402752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:09.410821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9605ff2f-36c7-4025-9f88-5bbdf2e6a6bc tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1691 microversion: 2.1 time: 0.150763 May 10 14:09:09.411394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 321/622] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:09 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:10.427194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:10.427827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:10.434934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:10.435413 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:10.436469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:10.436934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:10.507620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:10.515213 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8eca8401-9304-4a8a-a48d-5cf96212b932 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 200 len: 1623 microversion: 2.1 time: 0.091916 May 10 14:09:10.515796 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 302/623] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:10 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:10.675751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-ed59306b-9a2b-4e3b-b2af-9528d46c2d9c req-af7ce55c-9f81-4509-8df1-d0ccaa5d84a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c96bfa-9abc-4b43-a1fc-e9b75d8436cd", "name": "network-vif-deleted", "tag": "8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:10.685473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-ed59306b-9a2b-4e3b-b2af-9528d46c2d9c req-af7ce55c-9f81-4509-8df1-d0ccaa5d84a2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:10.686757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-ed59306b-9a2b-4e3b-b2af-9528d46c2d9c req-af7ce55c-9f81-4509-8df1-d0ccaa5d84a2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:10.699954 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-ed59306b-9a2b-4e3b-b2af-9528d46c2d9c req-af7ce55c-9f81-4509-8df1-d0ccaa5d84a2 service nova] Creating event network-vif-deleted:8a5e5f9e-3ecc-489e-830a-8a06ae7f9e91 for instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd on hv-cinder-83588 May 10 14:09:10.708875 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-ed59306b-9a2b-4e3b-b2af-9528d46c2d9c req-af7ce55c-9f81-4509-8df1-d0ccaa5d84a2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038851 May 10 14:09:10.709488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 322/624] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:11.534648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:11.535264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:11.541741 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:11.542177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:11.542976 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:11.543412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:11.557259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] HTTP exception thrown: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Request method failure captured: May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd HTTP/1.1 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIg0Kt1vEsK0v55lcfihVciib-NJkhVshJVV6NMx8ilUp4B4YfQ3KwbQUxwb-DsrIzWDBZfjdva7wvnq74azHqHwO7Ri-IZ5oENA7fNKssFN6ySubXbUIuPp1B1jOfDl4oUWR3pF8q59CWKnAQsV2rlXWNx0sT495AlBPjNysBm2g May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:09:11.558946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_523029c9401f49c399be46bfe308b5e6", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 1897b88622664ceca4deac5a22079726 May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. May 10 14:09:11.560505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '05c96bfa-9abc-4b43-a1fc-e9b75d8436cd'} May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:11.561433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. May 10 14:09:11.562934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:11.564247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Returning 404 to user: Instance 05c96bfa-9abc-4b43-a1fc-e9b75d8436cd could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:11.564247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-23ec5b99-4c53-4c03-99ed-c7158a689560 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd" status: 404 len: 111 microversion: 2.1 time: 0.031338 May 10 14:09:11.564247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 303/625] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:11 2022] GET /compute/v2.1/servers/05c96bfa-9abc-4b43-a1fc-e9b75d8436cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:11.570278 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0e02a17d-505e-4022-9a0f-41b6413d1445 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '.version_select at 0x7efd56227790>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:11.587951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0e02a17d-505e-4022-9a0f-41b6413d1445 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228130064" status: 202 len: 0 microversion: 2.1 time: 0.021774 May 10 14:09:11.588533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 323/626] 10.222.0.32 () {58 vars in 1220 bytes} [Tue May 10 14:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1228130064 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:14.479013 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:14.479522 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:14.485848 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:14.486468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:14.487578 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:14.488027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:14.513086 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:14.589240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5b288286-ef0e-4b8a-b923-26b59ed03443 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 204 len: 0 microversion: 2.1 time: 0.113888 May 10 14:09:14.589826 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 304/627] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:09:14 2022] DELETE /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:14.599656 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:14.600472 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:14.606804 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:14.607335 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:14.608110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:14.608553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:14.744150 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:14.752677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b46cd5c5-369d-4128-981e-f40462d34144 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1508 microversion: 2.1 time: 0.158157 May 10 14:09:14.753637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 324/628] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:14 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:15.784661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:15.785986 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:15.794576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:15.795311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:15.796282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:15.796924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:15.833618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-f999b443-7ee2-47a4-911b-e0b74ea21a1d req-0f99636a-2d03-4578-8734-54733ba78c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead53d16-350b-428b-abb0-ee729094fae0", "name": "network-vif-deleted", "tag": "fec44231-1d3b-4ecc-b5bb-dddd45402204"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:15.843264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-f999b443-7ee2-47a4-911b-e0b74ea21a1d req-0f99636a-2d03-4578-8734-54733ba78c8c service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:15.843764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-f999b443-7ee2-47a4-911b-e0b74ea21a1d req-0f99636a-2d03-4578-8734-54733ba78c8c service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:15.869143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-f999b443-7ee2-47a4-911b-e0b74ea21a1d req-0f99636a-2d03-4578-8734-54733ba78c8c service nova] Creating event network-vif-deleted:fec44231-1d3b-4ecc-b5bb-dddd45402204 for instance ead53d16-350b-428b-abb0-ee729094fae0 on hv-cinder-83588 May 10 14:09:15.874809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-f999b443-7ee2-47a4-911b-e0b74ea21a1d req-0f99636a-2d03-4578-8734-54733ba78c8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045039 May 10 14:09:15.875817 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 325/629] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:15.885676 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:15.896293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-507faafa-6530-43e6-88f3-b0816523f4d5 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 200 len: 1466 microversion: 2.1 time: 0.127665 May 10 14:09:15.897184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 305/630] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:15 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 1466 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:16.914971 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:16.915685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: ead53d16-350b-428b-abb0-ee729094fae0] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:16.921818 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:16.922306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:16.923075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:16.923516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:16.936750 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] HTTP exception thrown: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Request method failure captured: May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 HTTP/1.1 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIg0Kt1vEsK0v55lcfihVciib-NJkhVshJVV6NMx8ilUp4B4YfQ3KwbQUxwb-DsrIzWDBZfjdva7wvnq74azHqHwO7Ri-IZ5oENA7fNKssFN6ySubXbUIuPp1B1jOfDl4oUWR3pF8q59CWKnAQsV2rlXWNx0sT495AlBPjNysBm2g May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:09:16.938367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_523029c9401f49c399be46bfe308b5e6", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1897b88622664ceca4deac5a22079726 May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. May 10 14:09:16.940097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'ead53d16-350b-428b-abb0-ee729094fae0'} May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:16.941046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. May 10 14:09:16.942476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:16.943702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Returning 404 to user: Instance ead53d16-350b-428b-abb0-ee729094fae0 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:16.943702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8c12bab7-dd5f-4dae-a0c6-bffffc56ef37 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0" status: 404 len: 111 microversion: 2.1 time: 0.029516 May 10 14:09:16.943702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 326/631] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:16 2022] GET /compute/v2.1/servers/ead53d16-350b-428b-abb0-ee729094fae0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:16.948265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:16.948763 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:16.955021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:16.956024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:16.956966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:16.957405 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:16.985058 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:17.059515 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-725031bd-3e8d-4949-b607-74f6cde2641c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 204 len: 0 microversion: 2.1 time: 0.114840 May 10 14:09:17.063034 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 306/632] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:09:16 2022] DELETE /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:17.068690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:17.069304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:17.075306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:17.075781 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:17.076557 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:17.077001 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:17.208576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:17.216009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ce7e6ee7-7340-465e-95fe-c732bb26216c tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1520 microversion: 2.1 time: 0.151728 May 10 14:09:17.216570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 327/633] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:17 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:18.233497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:18.234246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:18.241101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:18.241552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:18.242379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:18.243009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:18.244125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-d1903bfa-e0e2-4582-b23d-6b64c0774afd req-f4f9db8b-1108-48a5-a05e-36ea05254198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8618c48-35fd-41ab-975f-ae42c69a6a94", "name": "network-vif-deleted", "tag": "7fcebda4-a245-47da-98d3-1c315a7310e9"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:18.253151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d1903bfa-e0e2-4582-b23d-6b64c0774afd req-f4f9db8b-1108-48a5-a05e-36ea05254198 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:18.253720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d1903bfa-e0e2-4582-b23d-6b64c0774afd req-f4f9db8b-1108-48a5-a05e-36ea05254198 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:18.264764 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-d1903bfa-e0e2-4582-b23d-6b64c0774afd req-f4f9db8b-1108-48a5-a05e-36ea05254198 service nova] Creating event network-vif-deleted:7fcebda4-a245-47da-98d3-1c315a7310e9 for instance f8618c48-35fd-41ab-975f-ae42c69a6a94 on hv-cinder-83588 May 10 14:09:18.270478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-d1903bfa-e0e2-4582-b23d-6b64c0774afd req-f4f9db8b-1108-48a5-a05e-36ea05254198 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 May 10 14:09:18.271156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 328/634] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:18.309418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1897b88622664ceca4deac5a22079726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '523029c9401f49c399be46bfe308b5e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:18.316877 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-36d14ccc-3598-4ba6-a483-ee5f9ac64109 tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 200 len: 1478 microversion: 2.1 time: 0.087679 May 10 14:09:18.317458 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 307/635] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:18 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 1478 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:19.335115 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:19.335732 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] [instance: f8618c48-35fd-41ab-975f-ae42c69a6a94] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:19.341919 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:19.342411 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:19.343189 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:19.343632 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:19.357105 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] HTTP exception thrown: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Request method failure captured: May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 HTTP/1.1 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIg0Kt1vEsK0v55lcfihVciib-NJkhVshJVV6NMx8ilUp4B4YfQ3KwbQUxwb-DsrIzWDBZfjdva7wvnq74azHqHwO7Ri-IZ5oENA7fNKssFN6ySubXbUIuPp1B1jOfDl4oUWR3pF8q59CWKnAQsV2rlXWNx0sT495AlBPjNysBm2g May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:09:19.358745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/523029c9401f49c399be46bfe308b5e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_523029c9401f49c399be46bfe308b5e6", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 523029c9401f49c399be46bfe308b5e6 May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2061806249 May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1897b88622664ceca4deac5a22079726 May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2061806249-project May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. May 10 14:09:19.360095 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'f8618c48-35fd-41ab-975f-ae42c69a6a94'} May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:19.360797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. May 10 14:09:19.363130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:19.364363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] Returning 404 to user: Instance f8618c48-35fd-41ab-975f-ae42c69a6a94 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:19.364363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1deced0c-a34a-4ef5-8613-f7bd3480a25f tempest-ServerRescueNegativeTestJSON-2061806249 tempest-ServerRescueNegativeTestJSON-2061806249-project] 10.222.0.32 "GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94" status: 404 len: 111 microversion: 2.1 time: 0.029924 May 10 14:09:19.364363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 329/636] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:19 2022] GET /compute/v2.1/servers/f8618c48-35fd-41ab-975f-ae42c69a6a94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:24.440729 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:24.442057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:24.448492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.448945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.449947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.450461 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.481031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-50d9374f-0887-4d8c-b3ba-3ab5a0b4af8f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045033 May 10 14:09:24.481592 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 308/637] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:24 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:09:24.539239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:24.539777 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:24.545975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.546459 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.547228 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.547662 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.575072 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:24.661718 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9667faf1-2330-400c-8d37-56e6487926f7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 204 len: 0 microversion: 2.1 time: 0.125726 May 10 14:09:24.662825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 330/638] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:09:24 2022] DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 14:09:24.671873 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:24.672484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:24.679651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.680375 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.681340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:24.681969 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:24.972831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:24.980326 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0ab5354e-dde2-4a7c-85f1-72bf1dd0bcb2 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1672 microversion: 2.1 time: 0.312875 May 10 14:09:24.980987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 309/639] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:24 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1672 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:25.998029 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:25.998747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:26.007733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.008420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.009810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:26.010702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:26.184348 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:26.194317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9373d4cc-495a-4e6c-b61b-8f18c100b625 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1672 microversion: 2.1 time: 0.201051 May 10 14:09:26.204700 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 331/640] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:25 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:27.212139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-63376e4f-8281-432f-8279-9d8904818bda req-6729f7d5-b23b-4485-a666-2148f257aafe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de2d918d-8df2-4251-a1e8-c73cb0c946c1", "name": "network-vif-deleted", "tag": "a3267fc0-8b43-4414-a63f-84901ac8ab21"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:27.212682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:27.213040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:27.220314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.220917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.222096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.222753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.238758 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-63376e4f-8281-432f-8279-9d8904818bda req-6729f7d5-b23b-4485-a666-2148f257aafe service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:27.245260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-63376e4f-8281-432f-8279-9d8904818bda req-6729f7d5-b23b-4485-a666-2148f257aafe service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:27.285474 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-63376e4f-8281-432f-8279-9d8904818bda req-6729f7d5-b23b-4485-a666-2148f257aafe service nova] Creating event network-vif-deleted:a3267fc0-8b43-4414-a63f-84901ac8ab21 for instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 on hv-cinder-83588 May 10 14:09:27.300114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-63376e4f-8281-432f-8279-9d8904818bda req-6729f7d5-b23b-4485-a666-2148f257aafe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090556 May 10 14:09:27.302553 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 310/641] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:27.397559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:27.411100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-37451471-5a78-4148-a767-3968678fa3a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 200 len: 1604 microversion: 2.1 time: 0.202158 May 10 14:09:27.411951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 332/642] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:27 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:28.429973 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:28.430876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:28.445127 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:28.445952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.447082 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:28.447621 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:28.469393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 HTTP/1.1 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:09:28.471309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:09:28.473091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'de2d918d-8df2-4251-a1e8-c73cb0c946c1'} May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:28.474009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:09:28.475428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:09:28.476725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:28.476725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8fdf86eb-8c9b-4c73-94e0-463d656cc0c4 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 404 len: 111 microversion: 2.1 time: 0.051136 May 10 14:09:28.480282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 311/643] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:28 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:28.485208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d46619c6-0aaf-4143-888f-44d855c09481 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '.version_select at 0x7efd56227430>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:28.524068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d46619c6-0aaf-4143-888f-44d855c09481 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505668752" status: 202 len: 0 microversion: 2.1 time: 0.042587 May 10 14:09:28.525287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 333/644] 10.222.0.32 () {58 vars in 1220 bytes} [Tue May 10 14:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505668752 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:09:29.140726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-677f635c-22b7-429f-95c2-20186109bfd7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: .version_select at 0x7efd562c24c0>, body: {"keypair": {"name": "tempest-keypair-1984660144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD+X32NbDyGN9DMWwZvTojQudcykJfeRwfgYedb30kAdPzO9Dr3IhQiN3LxCtLZqBV/0kdkVQ0iuhWFGd6dXXq8cDLHkiUS8pYRqvtfbLVu3j0is4V8xm8q1etuB8NrO7Q=="}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:29.154749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-677f635c-22b7-429f-95c2-20186109bfd7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for project c251b9c401c6455da95be74c9119b8d2. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:29.160294 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-677f635c-22b7-429f-95c2-20186109bfd7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for user 3069e17bfc5d4e34ab7f5c61f48d9f11 and project c251b9c401c6455da95be74c9119b8d2. Resources: {'key_pairs'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:29.185084 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-677f635c-22b7-429f-95c2-20186109bfd7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.171812 May 10 14:09:29.185810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 312/645] 10.222.0.32 () {62 vars in 1199 bytes} [Tue May 10 14:09:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 14:09:29.411376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9fcab8eb-ab92-42e1-bf3d-5e766e1d2f03 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: .version_select at 0x7efd5615f040>, body: {"keypair": {"name": "tempest-keypair-735097045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Vsv8v2z4Irw+IR6hcQit7Gx6SReLBY5Y2YICjvUoumwSRJYN5+mykyqQqjlPsfx0UV8T/w7yTzugdRer4ekcjZwupQ1wFvnNlOOXEL3OFMCYEN1nqBEuizfOTn06wMw=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:29.426090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-9fcab8eb-ab92-42e1-bf3d-5e766e1d2f03 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:29.430634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-9fcab8eb-ab92-42e1-bf3d-5e766e1d2f03 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for user fb76fce14cf84b2bb4094fa2691777fe and project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:29.452408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9fcab8eb-ab92-42e1-bf3d-5e766e1d2f03 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045564 May 10 14:09:29.453274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 334/646] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:09:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:31.203857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1967665237", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a8e69b7-4e90-4197-9be6-027007b12991"}], "security_groups": [{"name": "tempest-securitygroup--363928709"}], "key_name": "tempest-keypair-1984660144", "user_data": "}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:31.367913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] validate_networks() for [('7a8e69b7-4e90-4197-9be6-027007b12991', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:09:31.463248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1877768608", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a39c3c0b-af42-4a48-a1bf-307b11e25d16"}], "security_groups": [{"name": "tempest-securitygroup--287630302"}], "key_name": "tempest-keypair-735097045", "user_data": "}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:31.589629 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] validate_networks() for [('a39c3c0b-af42-4a48-a1bf-307b11e25d16', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:09:31.793549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:09:31.794281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:09:31.795126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:09:31.795545 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:09:31.795963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:09:31.806655 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:31.807427 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:31.808777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:31.809398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:31.828065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for project c251b9c401c6455da95be74c9119b8d2. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:31.836132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for user 3069e17bfc5d4e34ab7f5c61f48d9f11 and project c251b9c401c6455da95be74c9119b8d2. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:31.848527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:09:31.850846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:09:31.958683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4edd32db-991b-4197-badf-fd3db1099a11 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.759071 May 10 14:09:31.963792 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 313/647] 10.222.0.32 () {62 vars in 1187 bytes} [Tue May 10 14:09:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 14:09:31.983262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:31.983893 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:32.075934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:32.089961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:32.092125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:32.094352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-90521065-fb19-4f7f-99e0-4bb395b30d68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1282 microversion: 2.20 time: 0.128254 May 10 14:09:32.095455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 314/648] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:31 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1282 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:32.132890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:09:32.133323 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:09:32.133803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:09:32.134243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:09:32.134691 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:09:32.147431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:32.147892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:32.148799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:32.149369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:32.183585 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:32.188561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Getting quotas for user fb76fce14cf84b2bb4094fa2691777fe and project 3327601a4d59466dbe9fb4ad689616f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:32.203068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:09:32.206473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:09:32.259090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-89ef064c-6364-4386-a24f-7e82a53f700f tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.800594 May 10 14:09:32.265381 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 335/649] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:09:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:09:32.273041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3b82ba58-b061-441f-ba95-90ebbed106af tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:32.274830 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3b82ba58-b061-441f-ba95-90ebbed106af tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:32.353761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3b82ba58-b061-441f-ba95-90ebbed106af tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:32.360401 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3b82ba58-b061-441f-ba95-90ebbed106af tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1237 microversion: 2.1 time: 0.093358 May 10 14:09:32.362669 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 315/650] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:32 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:33.114585 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.116152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:33.124245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.124752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.125645 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.126319 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.194893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:33.203506 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:33.205026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:33.207039 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e2062829-f7ce-4078-abeb-8126386f324a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1352 microversion: 2.20 time: 0.097697 May 10 14:09:33.207605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 336/651] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:33.379339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:33.380573 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:33.387808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.388271 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.389053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:33.389494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:33.536809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:33.546113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-53e68b38-7dc0-4b77-a1e7-b406b31c5670 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1297 microversion: 2.1 time: 0.172677 May 10 14:09:33.546855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 316/652] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:33 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1297 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:34.225729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:34.226369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:34.233045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.233486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.234493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.234832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.402558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:34.411669 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:34.413515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:34.414830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2f53e956-a70f-4a51-abb9-b8c546c634be tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.193668 May 10 14:09:34.415400 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 337/653] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:34 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:34.496321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:34.496811 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:34.504028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.504473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.505240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.505667 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.531267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7e0b48dc-3b1a-4c8e-99e7-eeb604a9c124 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/ips" status: 200 len: 150 microversion: 2.1 time: 0.038002 May 10 14:09:34.531267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 317/654] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:09:34 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:34.564969 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:34.566059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:34.580185 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.581802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.582709 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:34.583160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:34.737100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:34.758398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f4b28407-a0d9-48c7-aeba-82e3e3c20105 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.197702 May 10 14:09:34.760779 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 338/655] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:34 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:35.432917 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:35.433522 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:35.440939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.441798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.442708 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.443232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.730960 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:35.738829 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:35.740579 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:35.741852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5d166bdb-1081-4d7e-acb2-99401fda1dc0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.312809 May 10 14:09:35.742490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 318/656] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:35 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:35.775928 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:35.776567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:35.783269 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.784675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.785382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.785824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.822243 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-ba73b090-a660-4c46-9da0-455b7b15dcfe req-fe892224-cc57-4cb3-a302-8c31596e2d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:35.839956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ba73b090-a660-4c46-9da0-455b7b15dcfe req-fe892224-cc57-4cb3-a302-8c31596e2d93 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.840657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ba73b090-a660-4c46-9da0-455b7b15dcfe req-fe892224-cc57-4cb3-a302-8c31596e2d93 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.862542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-ba73b090-a660-4c46-9da0-455b7b15dcfe req-fe892224-cc57-4cb3-a302-8c31596e2d93 service nova] Creating event network-changed:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:09:35.871377 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-ba73b090-a660-4c46-9da0-455b7b15dcfe req-fe892224-cc57-4cb3-a302-8c31596e2d93 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054128 May 10 14:09:35.871983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 319/657] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:35.968973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:35.980906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-38fa2b5f-3bce-4e78-931a-3acb11ce1e00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.208743 May 10 14:09:35.981845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 339/658] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:35 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:35.987871 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d083e90a-9cc4-4d17-8c4c-5ff67d15b05f"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:35.989042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:35.995891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.996355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:35.997338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:35.998040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:36.301280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-11a7676d-9779-4efc-88ac-c1c709b87c86 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319951 May 10 14:09:36.307284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 320/659] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:09:35 2022] POST /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:36.760528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:36.761188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:36.767081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:36.768123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:36.768912 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:36.769342 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:36.898946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:36.906575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:36.908071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:36.909158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6081f700-e655-4356-9b8d-beeedf90f7bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.152614 May 10 14:09:36.909720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 340/660] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:36 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:36.999884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:37.000579 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:37.007673 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.008128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.008892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.009327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.135367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:37.143556 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2c2dac01-080c-43ed-995c-3b8342aaafc7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.148018 May 10 14:09:37.144133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 321/661] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:36 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:37.923856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-21e99252-0c1c-448e-b07a-e1860958f034 req-bcb727e2-d319-416b-a8ff-13a1c7c4392f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb4f03-fa9f-4382-b7ec-9c82669fc460", "tag": "e08d62c8-c7ae-4033-a35c-c2eaf43b7769"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:37.926567 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:37.927195 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:37.932425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-21e99252-0c1c-448e-b07a-e1860958f034 req-bcb727e2-d319-416b-a8ff-13a1c7c4392f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.932871 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-21e99252-0c1c-448e-b07a-e1860958f034 req-bcb727e2-d319-416b-a8ff-13a1c7c4392f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.933418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.933880 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.934709 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:37.935141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:37.943668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-21e99252-0c1c-448e-b07a-e1860958f034 req-bcb727e2-d319-416b-a8ff-13a1c7c4392f service nova] Creating event network-changed:e08d62c8-c7ae-4033-a35c-c2eaf43b7769 for instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 on hv-cinder-83588 May 10 14:09:37.948582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-21e99252-0c1c-448e-b07a-e1860958f034 req-bcb727e2-d319-416b-a8ff-13a1c7c4392f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028521 May 10 14:09:37.949175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 341/662] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:38.063973 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:38.071908 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:38.073438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:38.074572 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8646cb9f-2e55-4e1f-9866-2d70621c3b79 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.151944 May 10 14:09:38.075134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 322/663] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:37 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:09:38.160719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:38.161422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:38.167517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:38.167973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:38.168740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:38.169200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:38.294220 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:38.301610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e8c86985-8513-4f5e-abe6-9a7f2b5c98a9 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.145076 May 10 14:09:38.302169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 342/664] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:38 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:39.093176 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:39.093888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:39.101291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.101837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.102725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.103228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.288198 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:39.296003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:39.297494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:39.298617 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f039aa4e-6b40-4365-88a0-23e1bcf02f18 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.209441 May 10 14:09:39.299390 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 323/665] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:39 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:39.317847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:39.318493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:39.324853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.325306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.326077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:39.326555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:39.456395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:39.464300 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-083ede5e-fb83-4906-8710-f0722ad0783b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.150824 May 10 14:09:39.465076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 343/666] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:39 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:40.317027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:40.317632 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:40.324006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.324455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.325213 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.325644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.451452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:40.459560 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:40.461066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:40.462185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-79ee2cd9-6061-4f08-b6ee-07e556fec63a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.149647 May 10 14:09:40.462787 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 324/667] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:40 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:40.481642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:40.482289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:40.489153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.489597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.490422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:40.490843 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:40.621742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:40.629396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0acfff43-ca81-4fdd-ba9a-3c90f6cb7c89 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.151572 May 10 14:09:40.629966 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 344/668] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:40 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:41.480454 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:41.481338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:41.488775 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.489223 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:41.489993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.490483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:41.618963 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:41.627971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:41.629647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:41.630797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1c08c1ce-fb23-4320-a1da-654d1d273745 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.154252 May 10 14:09:41.631365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 325/669] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:41 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:41.645943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:41.646604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:41.652885 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.653343 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:41.654092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:41.654552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:41.783999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:41.791221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2d87411a-f87a-46e1-8404-74b8c7fd0147 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.149122 May 10 14:09:41.791790 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 345/670] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:41 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:42.649310 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:42.649921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:42.656284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:42.656731 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.657502 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:42.657940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.788468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:42.796733 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:42.798287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:42.799392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cb9b5715-f3fa-4aa6-9586-e9156b1fc143 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.154027 May 10 14:09:42.799957 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 326/671] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:42 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:42.808914 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:42.809535 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:42.815955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:42.816402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.817380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:42.817847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.931915 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-e5177c66-c4e5-4e77-8949-1c17ff12fc59 req-31a53779-c6f5-45cd-b01f-11c92f6371e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "name": "network-vif-plugged", "status": "completed", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:42.942138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e5177c66-c4e5-4e77-8949-1c17ff12fc59 req-31a53779-c6f5-45cd-b01f-11c92f6371e7 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:42.942847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e5177c66-c4e5-4e77-8949-1c17ff12fc59 req-31a53779-c6f5-45cd-b01f-11c92f6371e7 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:42.955735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-e5177c66-c4e5-4e77-8949-1c17ff12fc59 req-31a53779-c6f5-45cd-b01f-11c92f6371e7 service nova] Creating event network-vif-plugged:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:09:42.961930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-e5177c66-c4e5-4e77-8949-1c17ff12fc59 req-31a53779-c6f5-45cd-b01f-11c92f6371e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033993 May 10 14:09:42.963259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 327/672] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:42.974367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:42.983408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a9b33b47-cb4f-4262-be3e-adbde946784b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.178384 May 10 14:09:42.994697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 346/673] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:42 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:43.817835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:43.818585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:43.824776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.825231 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.825999 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:43.826465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:43.955236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:43.963927 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:43.965432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:43.966571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-eade4110-a0ac-4e0e-a6ce-d368a984afe0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1407 microversion: 2.20 time: 0.153530 May 10 14:09:43.967145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 328/674] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:43 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:44.001205 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:44.001819 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:44.008570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.009021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.009788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.010258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.138730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:44.146013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-02fb3be0-e089-42f4-9a7e-c2eaf83406a7 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.148986 May 10 14:09:44.146613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 347/675] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:43 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:44.985145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:44.985867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:44.993724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.994177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:44.995064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:44.995446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.131899 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.139658 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.141163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.142345 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a7f43f33-b2fa-40a5-a9cd-ac58ed83bd24 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1600 microversion: 2.20 time: 0.161213 May 10 14:09:45.142905 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 329/676] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:09:44 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:09:45.160552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:45.161642 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:45.163870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:45.164494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:45.168021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.168545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.169384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.169909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.170429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.170896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.171687 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:45.172114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:45.246333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b88a9b82-1369-430e-bbaf-9011c43ad861 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089754 May 10 14:09:45.246869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 348/677] 10.222.0.32 () {60 vars in 1315 bytes} [Tue May 10 14:09:45 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:09:45.298514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:45.320818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c35bf511-0d34-4ca3-b90a-5803cecd9fa0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.161252 May 10 14:09:45.321425 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 330/678] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:45 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:09:46.337337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:46.337955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:46.343926 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.344375 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.345148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.345587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.508174 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-eecf64da-cd38-484a-972d-777283ce008f req-108aba5a-68ac-4d15-81d3-399e325ae562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:46.517082 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-eecf64da-cd38-484a-972d-777283ce008f req-108aba5a-68ac-4d15-81d3-399e325ae562 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.517623 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-eecf64da-cd38-484a-972d-777283ce008f req-108aba5a-68ac-4d15-81d3-399e325ae562 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:46.529437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-eecf64da-cd38-484a-972d-777283ce008f req-108aba5a-68ac-4d15-81d3-399e325ae562 service nova] Creating event network-changed:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:09:46.534499 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-eecf64da-cd38-484a-972d-777283ce008f req-108aba5a-68ac-4d15-81d3-399e325ae562 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030183 May 10 14:09:46.534978 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 331/679] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:46.538815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:46.546417 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ffc84c4e-05cf-4e60-ae4f-5bb7bd1c2b00 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.213391 May 10 14:09:46.553613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 349/680] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:46 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:46.977078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-95aa1888-39fd-41c8-893a-142e4881c2dd req-9a3d61ab-1150-4065-a71c-20366e3b7214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcb4f03-fa9f-4382-b7ec-9c82669fc460", "name": "network-vif-plugged", "status": "completed", "tag": "e08d62c8-c7ae-4033-a35c-c2eaf43b7769"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:46.993567 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-95aa1888-39fd-41c8-893a-142e4881c2dd req-9a3d61ab-1150-4065-a71c-20366e3b7214 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:46.993792 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-95aa1888-39fd-41c8-893a-142e4881c2dd req-9a3d61ab-1150-4065-a71c-20366e3b7214 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.009031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-95aa1888-39fd-41c8-893a-142e4881c2dd req-9a3d61ab-1150-4065-a71c-20366e3b7214 service nova] Creating event network-vif-plugged:e08d62c8-c7ae-4033-a35c-c2eaf43b7769 for instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 on hv-cinder-83588 May 10 14:09:47.039460 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-95aa1888-39fd-41c8-893a-142e4881c2dd req-9a3d61ab-1150-4065-a71c-20366e3b7214 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066456 May 10 14:09:47.040131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 332/681] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:47.040867 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d083e90a-9cc4-4d17-8c4c-5ff67d15b05f"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:47.042462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.048973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.049424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.050331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.051158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.159362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: POST /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments HTTP/1.1 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 74 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:09:47.161945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {"volumeAttachment": {"volumeId": "d083e90a-9cc4-4d17-8c4c-5ff67d15b05f"}} May 10 14:09:47.163666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'server_id': '8a09a513-e43b-4233-a490-2041140d9dca', 'body': {'volumeAttachment': {'volumeId': 'd083e90a-9cc4-4d17-8c4c-5ff67d15b05f'}}} May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:47.164474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:47.165646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 400 to user: Invalid volume: volume d083e90a-9cc4-4d17-8c4c-5ff67d15b05f is already attached to instances: 8a09a513-e43b-4233-a490-2041140d9dca {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-15b60c36-2aac-4a05-9774-639f32556cd6 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128141 May 10 14:09:47.166892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 350/682] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:09:47 2022] POST /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:09:47.228443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:47.229024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.235486 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.235931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.236708 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.237149 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.322492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lazy-loading 'services' on Instance uuid 8a09a513-e43b-4233-a490-2041140d9dca {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:47.398193 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6d972f0c-9afd-40f9-8548-8ba975d8f095 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments/d083e90a-9cc4-4d17-8c4c-5ff67d15b05f" status: 202 len: 0 microversion: 2.1 time: 0.174074 May 10 14:09:47.398847 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 333/683] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:09:47 2022] DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments/d083e90a-9cc4-4d17-8c4c-5ff67d15b05f => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:47.407282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:47.408261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.416822 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.417271 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.418046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.418504 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.448889 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7645a7da-bd80-400a-9caa-44465e3c6d11 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 May 10 14:09:47.449780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 351/684] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:47 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:47.565704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:47.566426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:47.572544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.572991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.573754 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:47.574188 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:47.721012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:47.728883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bfd7f1fd-b1e6-4221-a36a-50e62c7f6cb0 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.167807 May 10 14:09:47.729457 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 334/685] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:47 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:48.460848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:48.461828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:48.468133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.468582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.469349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.469784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.499981 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c82af27c-769f-4dfe-b04b-3a1ab92d62d0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 May 10 14:09:48.500539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 352/686] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:48 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:48.745857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:48.746409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:48.753926 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.754498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.755304 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:48.755745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:48.887542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:48.895988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-df497ddc-dbb7-45dd-9855-1c165c3a97fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1362 microversion: 2.1 time: 0.153400 May 10 14:09:48.896684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 335/687] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:48 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:49.511701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:49.512621 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:49.518978 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.519442 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.520886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.521322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.550408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-552fce92-df71-4012-bb59-b98d75bf1242 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042764 May 10 14:09:49.551003 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 353/688] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:09:49 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:09:49.606642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:49.607140 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:49.612995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.613449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.614396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.614840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.639248 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:09:49.713273 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-22023f4c-719c-4ebb-b4a7-afb926719603 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 204 len: 0 microversion: 2.1 time: 0.110008 May 10 14:09:49.713946 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 336/689] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:09:49 2022] DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:09:49.722217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:49.722853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:49.728745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.729202 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.729975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.730448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.857955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:49.865923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4fe65c29-4e38-4bbe-8e51-9a49338b1750 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1680 microversion: 2.1 time: 0.147518 May 10 14:09:49.866508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 354/690] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:49 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:49.913456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:49.914148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:49.920412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.920857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:49.921648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:49.922080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.053098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:50.060585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-055763df-5edb-431c-9120-3a9b25726f26 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1547 microversion: 2.1 time: 0.151510 May 10 14:09:50.061096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 337/691] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:49 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:50.077850 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:50.078383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:50.085063 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.085516 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.086337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.086776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.163354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0c239f81-f579-42c2-8498-a7443eb82ad8 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089417 May 10 14:09:50.163978 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 355/692] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:09:50 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:50.883854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:50.884470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:50.890354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.890805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:50.891574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:50.892011 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:51.027132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:51.034575 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4ae3fdec-bb63-4ca4-8481-f3470d134f34 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1680 microversion: 2.1 time: 0.155155 May 10 14:09:51.035165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 338/693] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:50 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:51.127980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-bc6f1cca-a407-40e3-b5fa-9427019079ce req-9fe42f08-e62f-4776-a11e-5302777b3eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fcb4f03-fa9f-4382-b7ec-9c82669fc460", "tag": "e08d62c8-c7ae-4033-a35c-c2eaf43b7769"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:51.136654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-bc6f1cca-a407-40e3-b5fa-9427019079ce req-9fe42f08-e62f-4776-a11e-5302777b3eb4 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:51.137096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-bc6f1cca-a407-40e3-b5fa-9427019079ce req-9fe42f08-e62f-4776-a11e-5302777b3eb4 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:51.148474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-bc6f1cca-a407-40e3-b5fa-9427019079ce req-9fe42f08-e62f-4776-a11e-5302777b3eb4 service nova] Creating event network-changed:e08d62c8-c7ae-4033-a35c-c2eaf43b7769 for instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 on hv-cinder-83588 May 10 14:09:51.153397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-bc6f1cca-a407-40e3-b5fa-9427019079ce req-9fe42f08-e62f-4776-a11e-5302777b3eb4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029672 May 10 14:09:51.153998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 356/694] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:52.052029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:52.052646 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:52.059682 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.060128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.060903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.061340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.327434 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:52.335742 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9be14a0d-7356-45fd-bc21-7e6997bde27b tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1680 microversion: 2.1 time: 0.287824 May 10 14:09:52.336716 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 339/695] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:52 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1680 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:52.954929 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-a1c4e869-a85b-4f57-939f-620225ca8084 req-05010bbe-f19f-4b96-8e54-7a8ad4e4e0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a09a513-e43b-4233-a490-2041140d9dca", "name": "network-vif-deleted", "tag": "1277ce7c-0191-40fb-998f-f307d1835a4d"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:52.963253 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a1c4e869-a85b-4f57-939f-620225ca8084 req-05010bbe-f19f-4b96-8e54-7a8ad4e4e0a3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:52.963941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-a1c4e869-a85b-4f57-939f-620225ca8084 req-05010bbe-f19f-4b96-8e54-7a8ad4e4e0a3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:52.975170 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-a1c4e869-a85b-4f57-939f-620225ca8084 req-05010bbe-f19f-4b96-8e54-7a8ad4e4e0a3 service nova] Creating event network-vif-deleted:1277ce7c-0191-40fb-998f-f307d1835a4d for instance 8a09a513-e43b-4233-a490-2041140d9dca on hv-cinder-83588 May 10 14:09:52.980448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-a1c4e869-a85b-4f57-939f-620225ca8084 req-05010bbe-f19f-4b96-8e54-7a8ad4e4e0a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029958 May 10 14:09:52.981331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 357/696] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:53.353045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:53.353658 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:53.360087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:53.360550 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.361354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:53.361802 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.397184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:53.397641 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:53.398092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lazy-loading 'fault' on Instance uuid 8a09a513-e43b-4233-a490-2041140d9dca {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:09:53.445488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:53.453061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9fd5ad3e-4505-447b-aaa7-c1c4a41f1caa tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 200 len: 1331 microversion: 2.1 time: 0.103998 May 10 14:09:53.453639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 340/697] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:53 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:54.472137 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:54.472731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:54.479061 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.479507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.480259 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:54.480689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:54.494093 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca HTTP/1.1 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:09:54.495686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:09:54.497212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '8a09a513-e43b-4233-a490-2041140d9dca'} May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:09:54.498388 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:09:54.499799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:09:54.501100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:09:54.501100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-36ee79c1-3881-4d51-849e-ba62a66b181e tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 404 len: 111 microversion: 2.1 time: 0.029749 May 10 14:09:54.501100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 358/698] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:54 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:09:54.506817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dd01f076-3a88-4244-a6de-84f28b7ce0e8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '.version_select at 0x7efd56426dc0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:54.523250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dd01f076-3a88-4244-a6de-84f28b7ce0e8 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035504962" status: 202 len: 0 microversion: 2.1 time: 0.020997 May 10 14:09:54.523802 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 341/699] 10.222.0.32 () {58 vars in 1220 bytes} [Tue May 10 14:09:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035504962 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:09:55.125614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-93515ebb-f22a-4fb7-b7e8-357f1a1b7b98 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: .version_select at 0x7efd5617fca0>, body: {"keypair": {"name": "tempest-keypair-778080406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKZ4w6wHTZyVQ8CTOEHN4O6hjQwwORK92tC4XJS90xHSi5MTucSOZHBNlqyz2z+a6Vj498Nen2N3dnXflqo4HXnIH5t83/YzhRdsuzVHXlVZcSf2kGl8VbYsFU8p7bVjw=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:55.138968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-93515ebb-f22a-4fb7-b7e8-357f1a1b7b98 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:55.142662 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-93515ebb-f22a-4fb7-b7e8-357f1a1b7b98 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:55.164390 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-93515ebb-f22a-4fb7-b7e8-357f1a1b7b98 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.042802 May 10 14:09:55.165027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 359/700] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:09:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:09:56.412314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1608974223", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c07cd0-6152-43ba-84e4-0ef3e3d224df"}], "security_groups": [{"name": "tempest-securitygroup--850072441"}], "key_name": "tempest-keypair-778080406", "user_data": "}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:56.516319 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] validate_networks() for [('49c07cd0-6152-43ba-84e4-0ef3e3d224df', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:09:56.876298 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:09:56.876725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:09:56.877204 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:09:56.877916 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:09:56.878402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:09:56.887557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.888012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.888818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:56.889257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:56.906087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:09:56.909964 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Getting quotas for user c98a5fc7863942c5b389aa9766d31129 and project 47d6a9eb6fd3415d9059fe567e2dfa02. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:09:56.921140 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:09:56.923437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:09:56.971435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b7e83c41-e194-428b-93c1-87d5bf849e6a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564638 May 10 14:09:56.972081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 342/701] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:09:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:09:56.982273 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1f242a8c-8a49-49ee-8a05-17ac6890455c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:56.982884 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1f242a8c-8a49-49ee-8a05-17ac6890455c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:57.041832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1f242a8c-8a49-49ee-8a05-17ac6890455c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:57.049234 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1f242a8c-8a49-49ee-8a05-17ac6890455c tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1241 microversion: 2.1 time: 0.071243 May 10 14:09:57.049790 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 360/702] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:56 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:58.066750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:58.067371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:58.074412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:58.074876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:58.075657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:58.076102 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:58.152353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:58.159644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b3bfd609-3b6d-4fa9-aff6-eec654896af2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1299 microversion: 2.1 time: 0.097336 May 10 14:09:58.160353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 343/703] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:58 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:09:59.177180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:09:59.177788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:09:59.185123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:59.185660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:59.186483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:59.186907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:59.246053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-fd476fc4-d948-4a34-8d84-72aad8a94f93 req-433e623b-9e88-4074-8aa9-9334a3b2a576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1184fe9-ade1-4a51-8e67-378fdad8cc64", "tag": "7285d884-f81b-42b7-b37d-c408d01c64b0"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:09:59.260126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-fd476fc4-d948-4a34-8d84-72aad8a94f93 req-433e623b-9e88-4074-8aa9-9334a3b2a576 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:09:59.263897 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-fd476fc4-d948-4a34-8d84-72aad8a94f93 req-433e623b-9e88-4074-8aa9-9334a3b2a576 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:09:59.278071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-fd476fc4-d948-4a34-8d84-72aad8a94f93 req-433e623b-9e88-4074-8aa9-9334a3b2a576 service nova] Creating event network-changed:7285d884-f81b-42b7-b37d-c408d01c64b0 for instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 on hv-cinder-83588 May 10 14:09:59.284576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-fd476fc4-d948-4a34-8d84-72aad8a94f93 req-433e623b-9e88-4074-8aa9-9334a3b2a576 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041314 May 10 14:09:59.286966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 344/704] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:09:59.358990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:09:59.368020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bcb82b8b-4d52-447c-ba29-5cfbfea330dc tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.194595 May 10 14:09:59.368611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 361/705] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:09:59 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:00.386693 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:00.387409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:00.393522 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:00.393980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:00.394891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:00.395331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:00.521306 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:00.528571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2b27aa6d-dc09-44f4-a877-05000e3c6448 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.146707 May 10 14:10:00.529138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 345/706] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:00 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:01.545920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:01.546564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:01.553173 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:01.553626 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:01.554426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:01.554892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:01.679350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:01.686586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a17366b3-4e6e-4138-ad6d-adca2fd18b60 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.144525 May 10 14:10:01.687157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 362/707] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:01 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:02.703911 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:02.704529 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:02.711423 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:02.711901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:02.712674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:02.713115 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:02.847374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:02.855381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-31de1743-caef-4a42-ad45-55598e3323d1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.155282 May 10 14:10:02.855960 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 346/708] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:02 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:03.872732 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:03.873594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:03.879998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:03.880440 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:03.881197 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:03.881627 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:04.010348 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:04.017547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9021196f-dd94-47ce-a4a9-ba1d1bcab8a2 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.148633 May 10 14:10:04.018116 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 363/709] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:03 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:05.009235 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-cea43d56-e992-44c8-b523-3f0a3bc21b78 req-66f4f396-e1d4-4e99-9aa4-b6ea96d3790d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1184fe9-ade1-4a51-8e67-378fdad8cc64", "name": "network-vif-plugged", "status": "completed", "tag": "7285d884-f81b-42b7-b37d-c408d01c64b0"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:10:05.017687 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-cea43d56-e992-44c8-b523-3f0a3bc21b78 req-66f4f396-e1d4-4e99-9aa4-b6ea96d3790d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:05.018214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-cea43d56-e992-44c8-b523-3f0a3bc21b78 req-66f4f396-e1d4-4e99-9aa4-b6ea96d3790d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:05.030947 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-cea43d56-e992-44c8-b523-3f0a3bc21b78 req-66f4f396-e1d4-4e99-9aa4-b6ea96d3790d service nova] Creating event network-vif-plugged:7285d884-f81b-42b7-b37d-c408d01c64b0 for instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 on hv-cinder-83588 May 10 14:10:05.034164 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:05.034812 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:05.036698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-cea43d56-e992-44c8-b523-3f0a3bc21b78 req-66f4f396-e1d4-4e99-9aa4-b6ea96d3790d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031091 May 10 14:10:05.037464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 347/710] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:10:05.041491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:05.041948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:05.042738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:05.043168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:05.177659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:05.185287 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-469626fe-1c96-4a27-bd9f-a84cc75c7643 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.155125 May 10 14:10:05.185860 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 364/711] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:05 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:10:06.203364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:06.203988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:06.210344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:06.210799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:06.211569 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:06.212011 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:06.336983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:06.344289 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6e620f7d-abdd-4b6d-a106-211e929c7f66 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1366 microversion: 2.1 time: 0.145884 May 10 14:10:06.344871 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 348/712] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:06 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:07.360890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:07.361497 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:07.369315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:07.369760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:07.370578 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:07.371013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:07.501285 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:07.509358 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bf9b89f7-7415-4aa5-b4bf-cc70a9f91065 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1556 microversion: 2.1 time: 0.152341 May 10 14:10:07.509931 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 365/713] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:07 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:07.525906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:07.526437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:07.532461 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:07.532912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:07.533678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:07.534113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:07.615526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-749a5ad4-f860-4592-aab9-a965baf5fb22 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093369 May 10 14:10:07.616125 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 349/714] 10.222.0.32 () {58 vars in 1274 bytes} [Tue May 10 14:10:07 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:10:08.604128 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-0e149fc4-c9f0-489a-91df-161c74628a03 req-be71ffb3-aa52-43d8-b986-63fc19a6c3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1184fe9-ade1-4a51-8e67-378fdad8cc64", "tag": "7285d884-f81b-42b7-b37d-c408d01c64b0"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:10:08.612538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-0e149fc4-c9f0-489a-91df-161c74628a03 req-be71ffb3-aa52-43d8-b986-63fc19a6c3e9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:08.613013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-0e149fc4-c9f0-489a-91df-161c74628a03 req-be71ffb3-aa52-43d8-b986-63fc19a6c3e9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:08.624141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-0e149fc4-c9f0-489a-91df-161c74628a03 req-be71ffb3-aa52-43d8-b986-63fc19a6c3e9 service nova] Creating event network-changed:7285d884-f81b-42b7-b37d-c408d01c64b0 for instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 on hv-cinder-83588 May 10 14:10:08.629393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-0e149fc4-c9f0-489a-91df-161c74628a03 req-be71ffb3-aa52-43d8-b986-63fc19a6c3e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029046 May 10 14:10:08.630141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 366/715] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:10:41.345229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:41.345748 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:41.349480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-e56b0cdb-5eea-4e5c-942c-8bed61597ecc req-17354250-6ad3-4cb4-a3e4-1de5757ecd1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:10:41.354639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:41.355347 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:41.356344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:41.356792 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:41.358986 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e56b0cdb-5eea-4e5c-942c-8bed61597ecc req-17354250-6ad3-4cb4-a3e4-1de5757ecd1e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:41.359434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e56b0cdb-5eea-4e5c-942c-8bed61597ecc req-17354250-6ad3-4cb4-a3e4-1de5757ecd1e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:41.372034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-e56b0cdb-5eea-4e5c-942c-8bed61597ecc req-17354250-6ad3-4cb4-a3e4-1de5757ecd1e service nova] Creating event network-changed:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:10:41.377416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-e56b0cdb-5eea-4e5c-942c-8bed61597ecc req-17354250-6ad3-4cb4-a3e4-1de5757ecd1e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 May 10 14:10:41.378016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 367/716] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:10:41.385483 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:10:41.466943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-82285102-c285-4138-93a5-bc1051d364ce tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 204 len: 0 microversion: 2.1 time: 0.125142 May 10 14:10:41.467643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 350/717] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:10:41 2022] DELETE /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:10:41.477534 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:41.478395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:41.485330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:41.485330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:41.486138 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:41.486605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:41.623266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:41.630604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-06180e1f-c72d-430a-bea9-d2449a978502 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.157984 May 10 14:10:41.631218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 368/718] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:41 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:42.649648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:42.650394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:42.656911 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:42.657359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:42.658127 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:42.658590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:43.065408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:43.073551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5fec1ac8-19d6-4d70-961e-544cc2bff874 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1567 microversion: 2.1 time: 0.428868 May 10 14:10:43.074127 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 351/719] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:42 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1567 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:43.587079 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-c92fd2c2-8121-45c3-9726-973524db2956 req-8c9ff44c-fcfa-4f22-a745-12b02d3a2e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6890fa7d-7922-4684-84e7-9dba0e4e6329", "name": "network-vif-deleted", "tag": "ec9f4864-21aa-4de7-919c-01a3ed1478c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:10:43.595690 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-c92fd2c2-8121-45c3-9726-973524db2956 req-8c9ff44c-fcfa-4f22-a745-12b02d3a2e78 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:43.596136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-c92fd2c2-8121-45c3-9726-973524db2956 req-8c9ff44c-fcfa-4f22-a745-12b02d3a2e78 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:43.608305 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-c92fd2c2-8121-45c3-9726-973524db2956 req-8c9ff44c-fcfa-4f22-a745-12b02d3a2e78 service nova] Creating event network-vif-deleted:ec9f4864-21aa-4de7-919c-01a3ed1478c2 for instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 on hv-cinder-83588 May 10 14:10:43.612997 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-c92fd2c2-8121-45c3-9726-973524db2956 req-8c9ff44c-fcfa-4f22-a745-12b02d3a2e78 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 May 10 14:10:43.613591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 369/720] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:10:44.091381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:44.091943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:44.098810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:44.099260 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:44.100191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:44.100830 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:44.132081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:44.132498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:44.132834 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lazy-loading 'fault' on Instance uuid 6890fa7d-7922-4684-84e7-9dba0e4e6329 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:10:44.173694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56462e4305424b099473d1e42adab9a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cb94e930984858b30744fc14ca334e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:10:44.183046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cd2de194-4a11-47bd-ae81-ac8ff7d3b0a9 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 200 len: 1223 microversion: 2.1 time: 0.095587 May 10 14:10:44.183640 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 352/721] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:44 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:10:45.201227 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:45.201838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] [instance: 6890fa7d-7922-4684-84e7-9dba0e4e6329] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:10:45.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:45.208688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:45.210478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:10:45.210920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:10:45.226106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] HTTP exception thrown: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Request method failure captured: May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 HTTP/1.1 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienDg_Yc-L64a8hQFcBjHXVLBGyU5Cl2f_NEbyxbL9KdW6ww1IloiDJ990QnC8TBhHa2UXCfcmdTJ8Mz6t-dagWUz6Nv7lqctmZbAzALq5sQNfrrrQewvqpaVfdTdV3veuwNc5E1TjINhLvTZ3Xj57H964d92kJc5xsuHR9YukVow7a4 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: a9cb94e930984858b30744fc14ca334e May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-TestShelveInstance-1613692336 May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:10:45.227762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a9cb94e930984858b30744fc14ca334e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/a9cb94e930984858b30744fc14ca334e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/a9cb94e930984858b30744fc14ca334e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_a9cb94e930984858b30744fc14ca334e", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-TestShelveInstance-1613692336 May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: a9cb94e930984858b30744fc14ca334e May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-TestShelveInstance-1613692336 May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-TestShelveInstance-1613692336-project May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 56462e4305424b099473d1e42adab9a9 May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-TestShelveInstance-1613692336-project May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. May 10 14:10:45.229363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '6890fa7d-7922-4684-84e7-9dba0e4e6329'} May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:10:45.230264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. May 10 14:10:45.231543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:10:45.232738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Returning 404 to user: Instance 6890fa7d-7922-4684-84e7-9dba0e4e6329 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:10:45.232738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-952af726-07fd-42fd-b96b-b15d62328bf7 tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329" status: 404 len: 111 microversion: 2.1 time: 0.032699 May 10 14:10:45.232738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 370/722] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:10:45 2022] GET /compute/v2.1/servers/6890fa7d-7922-4684-84e7-9dba0e4e6329 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:10:45.398797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-310a9fb9-b65e-492f-a5f2-8a3beff6132f tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] Calling method '.version_select at 0x7efd561d8ca0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:10:45.421114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-310a9fb9-b65e-492f-a5f2-8a3beff6132f tempest-TestShelveInstance-1613692336 tempest-TestShelveInstance-1613692336-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91343943" status: 202 len: 0 microversion: 2.1 time: 0.026561 May 10 14:10:45.421713 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 353/723] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:10:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91343943 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:11:01.667140 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:01.667654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:01.673846 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:01.674319 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:01.675077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:01.675506 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:01.699232 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bfb889cd-30b0-4e68-b7dd-5dbb4e6f41e3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/ips" status: 200 len: 153 microversion: 2.20 time: 0.036345 May 10 14:11:01.699808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 371/724] 10.222.0.32 () {60 vars in 1288 bytes} [Tue May 10 14:11:01 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:11:03.927916 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:03.928486 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:03.934487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:03.934943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:03.935717 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:03.936157 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:03.958393 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lazy-loading 'flavor' on Instance uuid 32252988-f2bf-4e25-adfe-fcc8ea12528d {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:11:04.223238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f7f7f651-6461-4a09-b7ba-0bbfdb487026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/action" status: 202 len: 0 microversion: 2.20 time: 0.299739 May 10 14:11:04.223926 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 354/725] 10.222.0.32 () {62 vars in 1318 bytes} [Tue May 10 14:11:03 2022] POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:11:04.232195 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:04.232809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:04.239507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:04.240066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:04.240827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:04.241404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:04.382458 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:04.390129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:04.391665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:04.392808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-250321fe-6892-4378-9edd-f3b7898b65d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.164651 May 10 14:11:04.393355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 372/726] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:04 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:05.068726 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:05.069321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:05.075690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:05.076157 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:05.076919 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:05.077360 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:05.100446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-2083e8fd-9b8a-4f6f-9d9a-55a522dece12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/ips" status: 200 len: 145 microversion: 2.1 time: 0.036687 May 10 14:11:05.101012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 355/727] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:11:05 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:05.411701 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:05.413016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:05.419301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:05.419755 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:05.420530 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:05.420974 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:05.546556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:05.554288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:05.555796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:05.556933 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dbafe7d4-9e2b-4a37-8ea8-370311cb6c92 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.149145 May 10 14:11:05.557478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 373/728] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:05 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:06.408768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45a1a3e4-39ab-4938-ad45-83313b0465ef"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:06.409930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:06.416324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:06.416780 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:06.417550 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:06.417987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:06.574505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:06.575117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:06.581439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:06.581880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:06.582679 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:06.583108 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:06.658764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-df89080b-e090-448e-b7c1-451d36aeb45b tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253691 May 10 14:11:06.665210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 356/729] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:11:06 2022] POST /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:06.728551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:06.737741 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:06.739649 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:06.741149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c4ba0c0d-5c6c-4c6d-9617-676b4119d1fd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.170494 May 10 14:11:06.742022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 374/730] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:06 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:07.760906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:07.761637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:07.767733 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:07.768182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:07.768955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:07.769397 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:07.898798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:07.906585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:07.908092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:07.909244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0003c718-ef7c-4da0-b252-2599a7b6254d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.153255 May 10 14:11:07.909805 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 357/731] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:07 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:08.928526 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:08.929497 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:08.936125 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:08.936585 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:08.937354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:08.937797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:09.061192 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:09.068976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:09.070518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:09.071668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-301da5fb-d804-4d68-8ac5-2fda9b90bc5c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.147876 May 10 14:11:09.072225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 375/732] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:08 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:10.092417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:10.093370 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:10.101059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:10.101647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:10.102869 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:10.103321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:10.255176 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:10.263640 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:10.265163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:10.266426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6570b713-c807-4d5b-990c-0eeb0de2bbe2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.180330 May 10 14:11:10.266990 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 358/733] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:10 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:11.285663 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:11.286266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:11.294471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:11.295097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:11.296293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:11.296729 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:11.435973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:11.444644 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:11.446503 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:11.447965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5f54cdc4-5fe4-4d71-95f0-1f1286f9c6bd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.166347 May 10 14:11:11.448528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 376/734] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:11 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:12.466223 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:12.466824 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:12.473207 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:12.473654 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:12.474446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:12.475423 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:12.604309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:12.612021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:12.613536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:12.614722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-645f99da-0e61-45af-8b60-dd8c92189f05 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.152478 May 10 14:11:12.616438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 359/735] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:12 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:13.634661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:13.635299 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:13.641624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:13.642099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:13.642917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:13.643355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:13.773486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:13.781308 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:13.782870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:13.784018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f7f9fc8e-1c90-4761-bcf2-4edd6009659d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.153762 May 10 14:11:13.784780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 377/736] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:13 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:14.129160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:14.130080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:14.136883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.137332 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.138092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.138552 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.167037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a06ca33c-5de9-41ae-b047-b3af2ad7183e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041715 May 10 14:11:14.167590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 360/737] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:14 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:14.177562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:14.178062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:14.184032 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.184488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.185262 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.185704 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.214779 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8935498b-2acc-45ea-b1cd-0937fc1ac989 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef" status: 200 len: 194 microversion: 2.1 time: 0.041162 May 10 14:11:14.215366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 378/738] 10.222.0.32 () {58 vars in 1412 bytes} [Tue May 10 14:11:14 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:14.802570 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:14.803765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:14.810009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.810585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.811559 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:14.812084 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:14.946972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:14.955744 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:14.957471 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:14.958828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-979a912b-2e77-4de6-8ec5-b7a1a5b20a3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.160099 May 10 14:11:14.959410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 361/739] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:14 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:15.528225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e2759d3-afae-4762-a2b5-e1818ccfd22b"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:15.529353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:15.535855 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:15.536309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:15.537096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:15.538168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:15.800042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1bb1a066-31f6-4599-afe5-89bd4dd1222c tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "POST /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275279 May 10 14:11:15.800771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 379/740] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:11:15 2022] POST /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:11:15.980053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:15.980589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:15.986951 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:15.987409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:15.988193 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:15.988636 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:16.154380 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:16.167051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:16.170051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:16.172875 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8ec5b645-70f2-4b80-a519-2165e4a69f50 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.197800 May 10 14:11:16.173326 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 362/741] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:15 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:17.192909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:17.194509 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:17.206591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:17.207422 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:17.208840 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:17.209623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:17.368793 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:17.377044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:17.378576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:17.379720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e27ce83d-306d-40f3-89d8-97e16d2aa027 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.192121 May 10 14:11:17.380266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 380/742] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:17 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:18.400051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:18.400693 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:18.409482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:18.409940 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:18.410962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:18.411629 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:18.557897 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:18.565896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:18.567590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:18.569608 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f1eac89b-7203-418b-a723-ad6af2e72a1b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.174822 May 10 14:11:18.570228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 363/743] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:18 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:19.588901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:19.589934 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:19.601334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:19.602165 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:19.603583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:19.604373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:20.005397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:20.015455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:20.016932 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:20.018066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b3a46fc5-c253-4096-9ac9-a2d24b962cc9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.435125 May 10 14:11:20.018664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 381/744] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:19 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:21.038520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:21.039287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:21.046648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:21.047113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:21.048060 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:21.048615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:21.200639 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:21.215374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:21.218415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:21.220644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d4d1b8bd-3833-435f-9e80-60e49f753c78 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1746 microversion: 2.20 time: 0.186718 May 10 14:11:21.221749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 364/745] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:21 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:22.243937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:22.245212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:22.256464 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:22.257539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:22.258373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:22.258757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:22.419450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:22.427721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:22.431069 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:22.433039 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b97595c7-beec-494d-ab5b-b5f15039665f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1746 microversion: 2.20 time: 0.197415 May 10 14:11:22.433593 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 382/746] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:22 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1746 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:23.402124 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:23.403080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:23.409701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.410262 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.411146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.411839 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.444340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ec4855c8-1f91-48b0-8ed0-56bc8b9f8b12 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045194 May 10 14:11:23.449827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 365/747] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:23 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:23.457471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:23.458156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:23.465078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.465543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.466559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.466999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.596398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:23.597081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:23.606626 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.607259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.608345 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.608928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.657641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:23.661755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ae726a40-5e25-4875-9ac7-7f8bc3fceb02 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef" status: 200 len: 194 microversion: 2.1 time: 0.069908 May 10 14:11:23.667013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:23.670237 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 366/748] 10.222.0.32 () {58 vars in 1412 bytes} [Tue May 10 14:11:23 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:23.670389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:23.670389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e38115f3-2788-4eaa-ab57-23eb9948b54a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1746 microversion: 2.20 time: 0.216459 May 10 14:11:23.670389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 383/749] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:23 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:23.684329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:23.684925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:23.692199 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.692738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.694263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:23.694745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:23.784957 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lazy-loading 'services' on Instance uuid 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:11:23.890449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b4f8fdee-1f98-42a5-b5a8-9da526cba085 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef" status: 202 len: 0 microversion: 2.1 time: 0.213706 May 10 14:11:23.891535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 367/750] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:11:23 2022] DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/45a1a3e4-39ab-4938-ad45-83313b0465ef => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:11:24.085181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:24.085670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:24.091646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:24.092092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:24.092884 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:24.093314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:24.116103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3e8bb92d-49bb-46eb-b809-728929c6cd12 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/ips" status: 200 len: 150 microversion: 2.1 time: 0.035395 May 10 14:11:24.116657 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 384/751] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:11:24 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:24.689613 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:24.690374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:24.697264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:24.697719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:24.698513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:24.698953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:24.832917 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:24.841523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:24.843077 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:24.844230 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-65ebc4b7-7c92-4199-8302-5b7e72f64d54 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1746 microversion: 2.20 time: 0.159341 May 10 14:11:24.844787 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 368/752] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:24 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:25.378034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-06f81cf2-0fa0-4aa6-bfed-9f0dd55f6d7b req-33b961c9-9ddc-4cae-ae45-a01405fcb191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "name": "network-vif-plugged", "status": "completed", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:25.388091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-06f81cf2-0fa0-4aa6-bfed-9f0dd55f6d7b req-33b961c9-9ddc-4cae-ae45-a01405fcb191 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:25.388575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-06f81cf2-0fa0-4aa6-bfed-9f0dd55f6d7b req-33b961c9-9ddc-4cae-ae45-a01405fcb191 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:25.404788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-06f81cf2-0fa0-4aa6-bfed-9f0dd55f6d7b req-33b961c9-9ddc-4cae-ae45-a01405fcb191 service nova] Creating event network-vif-plugged:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:11:25.410280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-06f81cf2-0fa0-4aa6-bfed-9f0dd55f6d7b req-33b961c9-9ddc-4cae-ae45-a01405fcb191 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 May 10 14:11:25.410983 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 385/753] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:25.863482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:25.864105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:25.872284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:25.873367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:25.875069 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:25.875511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.016291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:26.024910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:26.026442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:26.027616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5a422c98-f93b-44e4-9e1e-dce48969ba30 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1746 microversion: 2.20 time: 0.168209 May 10 14:11:26.028795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 369/754] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:25 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:26.058996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:26.059713 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:26.066372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.066823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.067586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.068019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.097663 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3f636ef2-26ff-4f70-86f5-9c22eb44f55e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/2e2759d3-afae-4762-a2b5-e1818ccfd22b" status: 200 len: 194 microversion: 2.1 time: 0.043086 May 10 14:11:26.098260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 386/755] 10.222.0.32 () {58 vars in 1412 bytes} [Tue May 10 14:11:26 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/2e2759d3-afae-4762-a2b5-e1818ccfd22b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:26.108719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:26.109155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:26.115027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.116330 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.117116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.117539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.195128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lazy-loading 'services' on Instance uuid 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:11:26.266329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c7f750c2-2083-44c7-944f-1fda4aeb7bcc tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/2e2759d3-afae-4762-a2b5-e1818ccfd22b" status: 202 len: 0 microversion: 2.1 time: 0.161339 May 10 14:11:26.266912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 370/756] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:11:26 2022] DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments/2e2759d3-afae-4762-a2b5-e1818ccfd22b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:11:26.480387 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04773fa3-dc56-404d-b7ff-ad2274cd7622"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:26.481454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:26.487924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.488377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.489155 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:26.489592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:26.806539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-313f9d0e-b138-442a-b4f8-b0074fa13ef0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "POST /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329984 May 10 14:11:26.807184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 387/757] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:11:26 2022] POST /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:11:27.046909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:27.047631 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:27.054287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.054738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.055502 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.055936 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.219610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:27.229758 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:27.231857 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:27.234124 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9e63450c-4dcd-4c95-a897-4ca9a9040b6b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.191872 May 10 14:11:27.234725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 371/758] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:27 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:27.484453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:27.485689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:27.494876 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.495721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.497159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.497933 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.543330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cca1e585-3dda-46ed-9499-a455c2608b86 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063620 May 10 14:11:27.544375 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 388/759] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:27 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:11:27.675884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:27.676900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:27.684949 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.685407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.686237 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.686684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.734184 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1017e006-c4aa-42b2-971c-227c4536799a tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061750 May 10 14:11:27.734833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 372/760] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:27 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:11:27.823235 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:27.825127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:27.839068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.840546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.842487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:27.843609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:27.898458 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:11:28.051377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5cd85bdd-d33a-4c66-aad1-7a70d16f2d66 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 204 len: 0 microversion: 2.1 time: 0.235146 May 10 14:11:28.058646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 389/761] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:27 2022] DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:11:28.063386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:28.064059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:28.073566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:28.074115 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:28.075036 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:28.075561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:28.246610 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:28.261817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-97a34e0f-32b5-49d1-ad76-ac3058a49b63 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1672 microversion: 2.1 time: 0.203391 May 10 14:11:28.263064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 373/762] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:28 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:11:28.272512 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:28.273597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:28.281409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:28.281948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:28.282838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:28.283357 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:28.441704 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:28.452577 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:28.454445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:28.455838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-939ab015-4dec-4869-85de-ff7efbba602e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.197155 May 10 14:11:28.456606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 390/763] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:28 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:29.283688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:29.284387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:29.291868 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:29.292324 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:29.293118 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:29.293555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:29.469748 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:29.475779 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:29.476458 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:29.489228 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-00530e8a-23d3-436b-b5fb-77c3625c4174 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1672 microversion: 2.1 time: 0.212323 May 10 14:11:29.500082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:29.500427 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:29.500814 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 374/764] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:29 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1672 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:29.502333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:29.503069 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:29.718466 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:29.731834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:29.733547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:29.735064 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4af9b423-c668-4206-9ba6-c65e7cbf94b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.263871 May 10 14:11:29.752073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 391/765] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:29 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:30.515828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:30.518352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:30.531004 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:30.531829 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:30.533041 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:30.533641 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:30.763187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:30.764161 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:30.773311 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:30.773904 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:30.774894 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:30.775420 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:30.869117 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76fce14cf84b2bb4094fa2691777fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3327601a4d59466dbe9fb4ad689616f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:30.896064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0638abaf-9344-4402-8efd-8b6e91dc1354 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 200 len: 1672 microversion: 2.1 time: 0.383840 May 10 14:11:30.896064 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 375/766] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:30 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 1672 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:30.993096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:31.017912 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:31.024102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:31.026176 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-92a5ddd4-edb1-4313-9813-11bbdb1c28d5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.271316 May 10 14:11:31.049486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 392/767] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:30 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:31.379146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-fe356d1a-830f-47b9-a42d-296bfc1b1df1 req-19d266a6-430d-4c9c-bbae-53b087f9700d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fcb4f03-fa9f-4382-b7ec-9c82669fc460", "name": "network-vif-deleted", "tag": "e08d62c8-c7ae-4033-a35c-c2eaf43b7769"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:31.404711 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-fe356d1a-830f-47b9-a42d-296bfc1b1df1 req-19d266a6-430d-4c9c-bbae-53b087f9700d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:31.405538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-fe356d1a-830f-47b9-a42d-296bfc1b1df1 req-19d266a6-430d-4c9c-bbae-53b087f9700d service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:31.421059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-fe356d1a-830f-47b9-a42d-296bfc1b1df1 req-19d266a6-430d-4c9c-bbae-53b087f9700d service nova] Creating event network-vif-deleted:e08d62c8-c7ae-4033-a35c-c2eaf43b7769 for instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 on hv-cinder-83588 May 10 14:11:31.441514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-fe356d1a-830f-47b9-a42d-296bfc1b1df1 req-19d266a6-430d-4c9c-bbae-53b087f9700d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065895 May 10 14:11:31.442576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 376/768] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:31.920426 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:31.921233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:31.936116 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:31.937754 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:31.938845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:31.939512 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:31.958481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 HTTP/1.1 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:31.962554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:31.963938 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '6fcb4f03-fa9f-4382-b7ec-9c82669fc460'} May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:31.964719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:31.965952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:31.969090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:31.970476 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f5ec7a4b-7d36-4e7f-bf89-636cfa154227 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 404 len: 111 microversion: 2.1 time: 0.056154 May 10 14:11:31.971136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 393/769] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:31 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:31.980924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d99de34c-b139-4249-a29d-08d2a392501e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '.version_select at 0x7efd561c7670>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:32.002112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d99de34c-b139-4249-a29d-08d2a392501e tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735097045" status: 202 len: 0 microversion: 2.1 time: 0.025595 May 10 14:11:32.002750 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 377/770] 10.222.0.32 () {58 vars in 1217 bytes} [Tue May 10 14:11:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735097045 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:11:32.056709 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:32.057603 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:32.064103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:32.064851 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:32.065825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:32.066452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:32.300935 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:32.312382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:32.314402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:32.315991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c31cd3f3-4ee3-4b61-a125-7dafbecf54a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.263592 May 10 14:11:32.317049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 394/771] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:32 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:33.336301 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:33.337737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:33.346577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:33.347024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:33.353950 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:33.354635 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:33.575538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:33.589966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:33.591674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:33.597527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a782e2b4-3305-474e-8ca3-715acde54791 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.266049 May 10 14:11:33.598488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 378/772] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:33 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:34.617573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:34.618237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:34.625017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.625463 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.626312 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.626760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.669872 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:34.670504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:34.677846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.678583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.679542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.679981 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.790347 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lazy-loading 'services' on Instance uuid b1184fe9-ade1-4a51-8e67-378fdad8cc64 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:11:34.806381 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:34.818636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:34.818636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:34.820460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1074aa96-5a7a-455e-944c-68ab079a0388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.205804 May 10 14:11:34.821567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 395/773] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:34 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:34.867943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-080eb5d4-32e0-42bc-928d-fcb9a2c410a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments/04773fa3-dc56-404d-b7ff-ad2274cd7622" status: 202 len: 0 microversion: 2.1 time: 0.201796 May 10 14:11:34.869008 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 379/774] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:11:34 2022] DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments/04773fa3-dc56-404d-b7ff-ad2274cd7622 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:11:34.877681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:34.878648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:34.886623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.888044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.889243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:34.890019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:34.931923 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-76cb12fe-d3ab-4c01-82ca-f07055f389cd tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058370 May 10 14:11:34.933529 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 396/775] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:34 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:11:35.261152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:35.261769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:35.269037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.269733 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.270914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.272000 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.285520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 HTTP/1.1 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:35.287514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.288938 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '6fcb4f03-fa9f-4382-b7ec-9c82669fc460'} May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:35.289785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.291252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:35.293408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:35.294281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c3a32c04-5a59-4450-aff9-2fc2ca01aaed tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 404 len: 111 microversion: 2.1 time: 0.037805 May 10 14:11:35.298139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 380/776] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:35 2022] DELETE /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:35.305004 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:35.305628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: 6fcb4f03-fa9f-4382-b7ec-9c82669fc460] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:35.311924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.313240 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.314404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.315159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.345033 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 HTTP/1.1 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:35.347016 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.348898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '6fcb4f03-fa9f-4382-b7ec-9c82669fc460'} May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:35.351329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. May 10 14:11:35.352920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:35.354725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance 6fcb4f03-fa9f-4382-b7ec-9c82669fc460 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:35.354725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5c45a16c-d96a-4a0b-a391-feaa662bbc55 tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460" status: 404 len: 111 microversion: 2.1 time: 0.049231 May 10 14:11:35.354725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 397/777] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:35 2022] GET /compute/v2.1/servers/6fcb4f03-fa9f-4382-b7ec-9c82669fc460 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:35.842440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:35.843934 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:35.851617 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.852311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.853274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.854075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.946405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:35.947416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:35.954157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.954893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.955882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:35.956355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:35.993507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-806f4c00-317a-4e19-b288-d554b75b1797 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052563 May 10 14:11:35.994216 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 398/778] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:11:35 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 14:11:36.019018 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:36.030718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:36.033099 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:36.034538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cbba6e5d-b6d4-44d4-95d5-acf2a2ffb0a7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.196335 May 10 14:11:36.035672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 381/779] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:35 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:36.064408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:36.064909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:36.071810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.072188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.072948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.073509 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.101519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:11:36.191286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-086756fc-0576-4777-a0c1-d38b51fa3af1 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 204 len: 0 microversion: 2.1 time: 0.130569 May 10 14:11:36.194412 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 399/780] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:36 2022] DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:11:36.200306 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:36.201164 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:36.207535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.207997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.209307 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.210093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.363928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:36.372686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7895f2b4-db67-4f79-8c68-9e072ea0d7a5 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1681 microversion: 2.1 time: 0.176146 May 10 14:11:36.383367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 382/781] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:36 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:36.516822 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:36.517614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:36.525445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.525924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.526751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.527352 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.543696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 HTTP/1.1 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:36.545637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.547028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'de2d918d-8df2-4251-a1e8-c73cb0c946c1'} May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:36.547739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.549027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:36.551067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:36.551067 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a1aa2842-184e-48f3-98c6-76e465d4f6fe tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 404 len: 111 microversion: 2.1 time: 0.035450 May 10 14:11:36.557855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:36.558507 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] [instance: de2d918d-8df2-4251-a1e8-c73cb0c946c1] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:36.560169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 400/782] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:36 2022] DELETE /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:36.564686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.565137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.565913 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:36.566389 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:36.584270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] HTTP exception thrown: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Request method failure captured: May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 HTTP/1.1 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienC3A9lg88u1Qhw8y06W1c_OFsP3pcMt3FI_qU7ZUqf6DLqwfWlEEF54HUP6EAVvQdoX1Kb9B8ZkgeYHcoc3v0cEYs50iNAlZMeb0G3HFJIiCSRv_H8o2Nye1dUVePCYeYd3Fck71-oC2LvVTzkFxuI0-bp0ymQnKgTI94QojKK8Mjc May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:36.585823 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/3327601a4d59466dbe9fb4ad689616f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_3327601a4d59466dbe9fb4ad689616f2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 3327601a4d59466dbe9fb4ad689616f2 May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787895563 May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: fb76fce14cf84b2bb4094fa2691777fe May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeTestJSON-1787895563-project May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.587343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'de2d918d-8df2-4251-a1e8-c73cb0c946c1'} May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:36.588080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. May 10 14:11:36.589317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:36.590624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] Returning 404 to user: Instance de2d918d-8df2-4251-a1e8-c73cb0c946c1 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:36.590624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1475efa2-f7d5-4086-a639-eea4e3c7b6aa tempest-AttachVolumeTestJSON-1787895563 tempest-AttachVolumeTestJSON-1787895563-project] 10.222.0.32 "GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1" status: 404 len: 111 microversion: 2.1 time: 0.034958 May 10 14:11:36.593358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 383/783] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:36 2022] GET /compute/v2.1/servers/de2d918d-8df2-4251-a1e8-c73cb0c946c1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:37.055368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:37.055901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:37.064612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:37.065069 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:37.068882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:37.068882 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:37.221614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:37.233051 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:37.235148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:37.236909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1af3ecb7-9222-4b74-acd9-3a4f0da6a02a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.185868 May 10 14:11:37.237757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 401/784] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:37 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:37.390527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:37.391142 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:37.399943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:37.400401 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:37.401198 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:37.401645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:37.658419 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:37.666791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3371b8d8-70e4-4cc3-bd55-72bd3a9b471d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1681 microversion: 2.1 time: 0.280124 May 10 14:11:37.668071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 384/785] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:37 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:38.257843 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:38.258560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:38.265491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:38.266668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:38.267796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:38.268233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:38.439563 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:38.449468 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:38.451029 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:38.452260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e04aadca-377c-485c-bb35-042cc1497c7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1741 microversion: 2.20 time: 0.199270 May 10 14:11:38.452823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 402/786] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:38 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:38.686252 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:38.687007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:38.694788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:38.695244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:38.696029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:38.696470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:39.083352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:39.091574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f1afbb99-017f-4044-b022-ac87349fccb4 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1681 microversion: 2.1 time: 0.409195 May 10 14:11:39.092600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 385/787] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:38 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1681 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:39.471266 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:39.471883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:39.479102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:39.479597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:39.480379 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:39.480820 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:39.619083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:39.627264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:39.628781 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:39.629941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-31c98fce-d7a9-463f-9a91-34f424551796 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1723 microversion: 2.20 time: 0.162707 May 10 14:11:39.630538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 403/788] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:39 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:40.111919 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:40.114429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:40.134354 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:40.135210 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:40.137334 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:40.138146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:40.524317 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-e01fb643-1134-4cb0-a0f8-cef05549ee40 req-fdb32b19-6243-4e68-bfa1-4bf47c4636c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1184fe9-ade1-4a51-8e67-378fdad8cc64", "name": "network-vif-deleted", "tag": "7285d884-f81b-42b7-b37d-c408d01c64b0"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:40.591469 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e01fb643-1134-4cb0-a0f8-cef05549ee40 req-fdb32b19-6243-4e68-bfa1-4bf47c4636c2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:40.593790 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e01fb643-1134-4cb0-a0f8-cef05549ee40 req-fdb32b19-6243-4e68-bfa1-4bf47c4636c2 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:40.641813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c98a5fc7863942c5b389aa9766d31129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d6a9eb6fd3415d9059fe567e2dfa02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:40.645745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-e01fb643-1134-4cb0-a0f8-cef05549ee40 req-fdb32b19-6243-4e68-bfa1-4bf47c4636c2 service nova] Creating event network-vif-deleted:7285d884-f81b-42b7-b37d-c408d01c64b0 for instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 on hv-cinder-83588 May 10 14:11:40.670727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-e01fb643-1134-4cb0-a0f8-cef05549ee40 req-fdb32b19-6243-4e68-bfa1-4bf47c4636c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149813 May 10 14:11:40.672591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 404/789] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:11:40.683234 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-aa1c23f5-eee7-4a9b-b292-b05ff857a351 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 200 len: 1614 microversion: 2.1 time: 0.556400 May 10 14:11:40.690603 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 386/790] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:40 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 1614 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:11:40.706122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:40.707606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:40.719636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:40.726523 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:40.728677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:40.730437 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:41.131089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:41.144769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:41.147136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:41.148436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-856ffdcd-02b0-43bd-bf9a-29b25b6c4eb8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1723 microversion: 2.20 time: 0.473484 May 10 14:11:41.149232 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 405/791] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:40 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:41.712422 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:41.713132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:41.721397 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:41.721835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:41.730931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:41.731401 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:41.755182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 HTTP/1.1 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:41.756994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:41.759381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'b1184fe9-ade1-4a51-8e67-378fdad8cc64'} May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:41.761001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:41.764321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:41.767730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:41.767730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-59147fb4-980b-48d9-8230-fb50155e9994 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 404 len: 111 microversion: 2.1 time: 0.050071 May 10 14:11:41.767730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 387/792] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:41 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:41.768351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ebb6eee6-b5aa-4781-ba4a-ee8f88c1af2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '.version_select at 0x7efd5612f310>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:41.810274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ebb6eee6-b5aa-4781-ba4a-ee8f88c1af2f tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-778080406" status: 202 len: 0 microversion: 2.1 time: 0.045886 May 10 14:11:41.811156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 406/793] 10.222.0.32 () {58 vars in 1217 bytes} [Tue May 10 14:11:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-778080406 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:11:42.171289 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:42.174482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:42.209298 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:42.210295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:42.211283 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:42.211921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:42.793297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:42.806641 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:42.808250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:42.810141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-46c11fb5-2aa6-43c1-a70b-79c99257259d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1723 microversion: 2.20 time: 0.645745 May 10 14:11:42.811305 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 388/794] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:42 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1723 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:43.439008 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-e59ef552-d482-40d9-8e12-13e861e1550e req-17909387-fafb-4517-a9d0-57491d902732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "name": "network-vif-unplugged", "status": "completed", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:43.454394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e59ef552-d482-40d9-8e12-13e861e1550e req-17909387-fafb-4517-a9d0-57491d902732 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:43.454859 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-e59ef552-d482-40d9-8e12-13e861e1550e req-17909387-fafb-4517-a9d0-57491d902732 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:43.474229 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.compute.server_external_events [req-e59ef552-d482-40d9-8e12-13e861e1550e req-17909387-fafb-4517-a9d0-57491d902732 service nova] Unable to find a host for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d. Dropping event network-vif-unplugged {{(pid=117186) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 14:11:43.476654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-e59ef552-d482-40d9-8e12-13e861e1550e req-17909387-fafb-4517-a9d0-57491d902732 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045204 May 10 14:11:43.477479 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 407/795] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 14:11:43.750267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4835acc6-6151-45d6-bede-547e6f44951d tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Action: 'create', calling method: .version_select at 0x7efd562369d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1263222774", "metadata": {"Type": "work"}}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4835acc6-6151-45d6-bede-547e6f44951d tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 122 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:43.769340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1263222774", "metadata": {"Type": "work"}}} May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: May 10 14:11:43.771581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1263222774', 'metadata': {'Type': 'work'}}}} May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise error May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi '#$%' May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:43.772619 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:11:43.774217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:11:43.775588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 14:11:43.775588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.775588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4835acc6-6151-45d6-bede-547e6f44951d tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:43.775588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4835acc6-6151-45d6-bede-547e6f44951d tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.135163 May 10 14:11:43.775588 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 389/796] 10.222.0.32 () {60 vars in 1155 bytes} [Tue May 10 14:11:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:11:43.783293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cc2c1cb0-8d15-4d01-8ca0-6ebf49d4ede9 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Action: 'create', calling method: .version_select at 0x7efd560cc8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1727508915", "metadata": {"Type": "work"}}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cc2c1cb0-8d15-4d01-8ca0-6ebf49d4ede9 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 120 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:43.787434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1727508915", "metadata": {"Type": "work"}}} May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:11:43.788906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1727508915', 'metadata': {'Type': 'work'}}}} May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise error May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi '0' May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:43.789856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:11:43.791521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:11:43.792743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 14:11:43.792743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:43.792743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cc2c1cb0-8d15-4d01-8ca0-6ebf49d4ede9 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:43.792743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cc2c1cb0-8d15-4d01-8ca0-6ebf49d4ede9 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009701 May 10 14:11:43.792743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 408/797] 10.222.0.32 () {60 vars in 1155 bytes} [Tue May 10 14:11:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:11:43.798233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3ebb9205-bf05-45b4-9066-ce17ce679b64 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Action: 'create', calling method: .version_select at 0x7efd561b0550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1071584290", "metadata": {"Type": "work"}}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3ebb9205-bf05-45b4-9066-ce17ce679b64 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 119 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:43.801244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1071584290", "metadata": {"Type": "work"}}} May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: May 10 14:11:43.802833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1071584290', 'metadata': {'Type': 'work'}}}} May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise error May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi '' May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:43.803773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 14:11:43.805258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 14:11:43.806497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 14:11:43.806497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:43.806497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3ebb9205-bf05-45b4-9066-ce17ce679b64 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:43.806497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3ebb9205-bf05-45b4-9066-ce17ce679b64 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008278 May 10 14:11:43.806497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 390/798] 10.222.0.32 () {60 vars in 1155 bytes} [Tue May 10 14:11:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 14:11:43.811750 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7c6b741e-781a-4332-a3c3-2ee98e2ec4ee tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Calling method '.version_select at 0x7efd56120820>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:43.829094 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:43.829397 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:43.838378 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:43.838840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:43.839645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:43.840089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:43.997766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.010652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.012925 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.014678 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bed29020-f636-4a01-bd77-5bcbfb97aa7b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1666 microversion: 2.20 time: 0.189685 May 10 14:11:44.015456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 391/799] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:43 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1666 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:44.023169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-7c6b741e-781a-4332-a3c3-2ee98e2ec4ee tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] HTTP exception thrown: Volume tempest-invalid-117211180 could not be found. May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7c6b741e-781a-4332-a3c3-2ee98e2ec4ee tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-117211180 HTTP/1.1 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:44.025728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume tempest-invalid-117211180 could not be found. May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'tempest-invalid-117211180'} May 10 14:11:44.027624 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-117211180 could not be found. (HTTP 404) (Request-ID: req-3093201a-4c14-4564-ab00-342f57d0ad3a) May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.028576 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:11:44.029989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-117211180 could not be found. May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:44.031404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-117211180 could not be found. May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-117211180 could not be found. May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7c6b741e-781a-4332-a3c3-2ee98e2ec4ee tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 404 to user: Volume tempest-invalid-117211180 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7c6b741e-781a-4332-a3c3-2ee98e2ec4ee tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-117211180" status: 404 len: 98 microversion: 2.1 time: 0.219254 May 10 14:11:44.032898 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 409/800] 10.222.0.32 () {58 vars in 1214 bytes} [Tue May 10 14:11:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-117211180 => generated 98 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 14:11:44.037517 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "650ef6b0-5828-4712-8c56-5685ee431277"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:44.038728 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:44.038848 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fcb1c21e-4b81-4b03-aa97-e52708444a2e tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004585 May 10 14:11:44.039606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 410/801] 10.222.0.32 () {58 vars in 1139 bytes} [Tue May 10 14:11:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 14:11:44.048288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b93dc9d4-6643-4c2c-bd00-c921082b8e45 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003948 May 10 14:11:44.048557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.048791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 411/802] 10.222.0.32 () {58 vars in 1136 bytes} [Tue May 10 14:11:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 14:11:44.049009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.049772 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.050217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.057559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f74bc4b1-4efc-457d-9076-a60d671e7921 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Calling method '.version_select at 0x7efd56141af0>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:44.085672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-f74bc4b1-4efc-457d-9076-a60d671e7921 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] HTTP exception thrown: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f74bc4b1-4efc-457d-9076-a60d671e7921 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/os-volumes/50e13f53-bd2d-4b05-a7fe-718d2f6205eb HTTP/1.1 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:44.087587 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '50e13f53-bd2d-4b05-a7fe-718d2f6205eb'} May 10 14:11:44.089070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. (HTTP 404) (Request-ID: req-cb7b2a5e-d9ae-48ed-a3b6-05a0f9332144) May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.090047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 14:11:44.091467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 14:11:44.092873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f74bc4b1-4efc-457d-9076-a60d671e7921 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 404 to user: Volume 50e13f53-bd2d-4b05-a7fe-718d2f6205eb could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f74bc4b1-4efc-457d-9076-a60d671e7921 tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/50e13f53-bd2d-4b05-a7fe-718d2f6205eb" status: 404 len: 109 microversion: 2.1 time: 0.035226 May 10 14:11:44.094237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 412/803] 10.222.0.32 () {58 vars in 1247 bytes} [Tue May 10 14:11:44 2022] DELETE /compute/v2.1/os-volumes/50e13f53-bd2d-4b05-a7fe-718d2f6205eb => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:44.099619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-feef1f83-e059-4cea-abee-370b0a402aca tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Calling method '.version_select at 0x7efd56120670>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:44.127194 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-feef1f83-e059-4cea-abee-370b0a402aca tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] HTTP exception thrown: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-feef1f83-e059-4cea-abee-370b0a402aca tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Request method failure captured: May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/os-volumes/f6d8e1f1-0277-4954-a758-b9aa75651bc5 HTTP/1.1 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienKfN31M-jVjwwEQjauUksUrw3I1okDXhxYjHWjuse-Thd4l4f9Sc_3ura3HYBmUC23ztkAXCTAZnj7twRofX0njsrXQO0Zhoo-Ha_nddvTezHuSnPpEuZMHwpzebz6rKDwDawnqhErQisBAFDL7-alpxngl800vBv3PK9ivzMydBTk May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:44.129277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/e20293595c62415a893d2f92e43c65b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_e20293595c62415a893d2f92e43c65b3", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: e20293595c62415a893d2f92e43c65b3 May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesNegativeTest-155995352 May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 1da21ac84a754cdfbc6dc529e8cd8553 May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesNegativeTest-155995352-project May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'f6d8e1f1-0277-4954-a758-b9aa75651bc5'} May 10 14:11:44.131450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. (HTTP 404) (Request-ID: req-eead690e-8ad5-4bda-a4d5-38d613c465f5) May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.133481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 14:11:44.136265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 14:11:44.138082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-feef1f83-e059-4cea-abee-370b0a402aca tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] Returning 404 to user: Volume f6d8e1f1-0277-4954-a758-b9aa75651bc5 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-feef1f83-e059-4cea-abee-370b0a402aca tempest-VolumesNegativeTest-155995352 tempest-VolumesNegativeTest-155995352-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f6d8e1f1-0277-4954-a758-b9aa75651bc5" status: 404 len: 109 microversion: 2.1 time: 0.036036 May 10 14:11:44.139462 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 413/804] 10.222.0.32 () {58 vars in 1244 bytes} [Tue May 10 14:11:44 2022] GET /compute/v2.1/os-volumes/f6d8e1f1-0277-4954-a758-b9aa75651bc5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:44.274728 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:44.275353 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:44.282124 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.282630 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.283415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.283917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.300112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 HTTP/1.1 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:44.302613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.304277 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'b1184fe9-ade1-4a51-8e67-378fdad8cc64'} May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:44.305143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.306828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.308184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:44.308184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-663bf518-8d57-457f-8c4f-0066724aa94d tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 404 len: 111 microversion: 2.1 time: 0.035093 May 10 14:11:44.308184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 414/805] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:44 2022] DELETE /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:11:44.315215 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:44.315844 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b1184fe9-ade1-4a51-8e67-378fdad8cc64] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:44.323237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.323767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.324562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.325026 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.345196 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 HTTP/1.1 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:44.346766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.348071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'b1184fe9-ade1-4a51-8e67-378fdad8cc64'} May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:44.348788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. May 10 14:11:44.350013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:44.351113 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b1184fe9-ade1-4a51-8e67-378fdad8cc64 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:44.351113 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-464bd2fa-0ae9-43bc-b38d-00dd6a327e3a tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64" status: 404 len: 111 microversion: 2.1 time: 0.038181 May 10 14:11:44.351113 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 415/806] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:44 2022] GET /compute/v2.1/servers/b1184fe9-ade1-4a51-8e67-378fdad8cc64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:44.363389 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-724f486e-abba-4c94-8a6f-240e8ae50110 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330202 May 10 14:11:44.364037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 392/807] 10.222.0.32 () {62 vars in 1363 bytes} [Tue May 10 14:11:44 2022] POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments => generated 188 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:11:44.496995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:11:44.496995 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:44.504043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.504493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.506000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.506468 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.593204 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-96064ce1-ffa9-4b8b-b049-7e37a8e170ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/action" status: 202 len: 0 microversion: 2.20 time: 0.101153 May 10 14:11:44.593965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 416/808] 10.222.0.32 () {62 vars in 1318 bytes} [Tue May 10 14:11:44 2022] POST /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 14:11:44.603050 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:44.603670 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:44.611010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.612602 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.613653 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:44.614149 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:44.791745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.805991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.808706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:44.810323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f0f96bcc-c800-49f9-b739-7341188ebebe tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1752 microversion: 2.20 time: 0.212284 May 10 14:11:44.810887 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 393/809] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:44 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:45.525214 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:45.526396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:45.533920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.534740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.535545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.535992 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.551908 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca HTTP/1.1 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:45.555680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.557309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '8a09a513-e43b-4233-a490-2041140d9dca'} May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:45.558152 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.559716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.561151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:45.561151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a37110a5-11ed-49a6-9310-bd0c956565e3 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 404 len: 111 microversion: 2.1 time: 0.036928 May 10 14:11:45.561151 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 417/810] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:45 2022] DELETE /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:11:45.567407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:45.568119 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 8a09a513-e43b-4233-a490-2041140d9dca] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:45.582442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.583150 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.584873 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.585438 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.600992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca HTTP/1.1 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:45.602593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.604085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '8a09a513-e43b-4233-a490-2041140d9dca'} May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:45.605139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. May 10 14:11:45.607583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.609513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 8a09a513-e43b-4233-a490-2041140d9dca could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:45.609513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9dcfc779-e51a-472f-ab25-66842d2d02f0 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca" status: 404 len: 111 microversion: 2.1 time: 0.040479 May 10 14:11:45.609513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 394/811] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:45 2022] GET /compute/v2.1/servers/8a09a513-e43b-4233-a490-2041140d9dca => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:45.613442 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:45.613942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:45.620572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.621018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.621869 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.622418 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.639115 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 HTTP/1.1 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:45.640925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.642972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '73002aaf-a92d-4871-be43-ae3e119a8492'} May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:45.644000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.645555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:45.647431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:45.647431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bef1a7d7-9afc-41b6-b02d-892753bf8baf tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 404 len: 111 microversion: 2.1 time: 0.033135 May 10 14:11:45.647431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 418/812] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:45 2022] DELETE /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:45.652338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:45.652995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: 73002aaf-a92d-4871-be43-ae3e119a8492] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:45.658969 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.659407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.661208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.661208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.674789 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 HTTP/1.1 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:45.676338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.678809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '73002aaf-a92d-4871-be43-ae3e119a8492'} May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:45.679952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. May 10 14:11:45.681341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:45.682867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance 73002aaf-a92d-4871-be43-ae3e119a8492 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:45.682867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-645964cb-a8dd-4832-9482-bfcd7bee3394 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492" status: 404 len: 111 microversion: 2.1 time: 0.030679 May 10 14:11:45.682867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 395/813] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:45 2022] GET /compute/v2.1/servers/73002aaf-a92d-4871-be43-ae3e119a8492 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:45.838484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:45.839136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:45.845806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.846297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:45.847085 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:45.847559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:46.274515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:46.283658 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:46.285210 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:46.286443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dba2bce8-2ff8-43dd-a05a-1d2983863b8d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1752 microversion: 2.20 time: 0.457387 May 10 14:11:46.287208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 419/814] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:45 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1752 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:46.838679 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:46.839238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:46.845546 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:46.846003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:46.846813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:46.847248 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:46.862882 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 HTTP/1.1 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:11:46.864498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.866085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'b01e464c-7bb4-4da3-b486-18b941be97b9'} May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:46.867078 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.868490 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:11:46.869831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:46.869831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f881ab03-aa50-4d8b-afb5-714c1dbe5b97 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 404 len: 111 microversion: 2.1 time: 0.031118 May 10 14:11:46.869831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 396/815] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:11:46 2022] DELETE /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:11:46.875768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:46.876604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] [instance: b01e464c-7bb4-4da3-b486-18b941be97b9] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:46.883730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:46.884217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:46.885048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:46.885534 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:46.900751 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] HTTP exception thrown: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Request method failure captured: May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 HTTP/1.1 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienBIYgcJHzwVvwyt8zqA0m4gJM0VLhkUh5yFQ2JqENnZTXo4QZyXPYjPkzcyOCWcicya5qFWLMiJvEiFnjDn9EC1XdkrYgjU5cGwTNRFovpFeqlYCH7itoaoOs6_eh8TpHPSgi8ksUgGZrTOpYrFcprokqXMrnKL68ph7OSs8XgzuvE May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:11:46.902508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/47d6a9eb6fd3415d9059fe567e2dfa02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_47d6a9eb6fd3415d9059fe567e2dfa02", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 47d6a9eb6fd3415d9059fe567e2dfa02 May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1682112706 May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: c98a5fc7863942c5b389aa9766d31129 May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeNegativeTest-1682112706-project May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.904022 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'b01e464c-7bb4-4da3-b486-18b941be97b9'} May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:11:46.904829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. May 10 14:11:46.906043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:11:46.907149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] Returning 404 to user: Instance b01e464c-7bb4-4da3-b486-18b941be97b9 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:11:46.907149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9fa319cd-cd7b-4d1a-a2e0-992a61dbf503 tempest-AttachVolumeNegativeTest-1682112706 tempest-AttachVolumeNegativeTest-1682112706-project] 10.222.0.32 "GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9" status: 404 len: 111 microversion: 2.1 time: 0.032994 May 10 14:11:46.907149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 420/816] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:11:46 2022] GET /compute/v2.1/servers/b01e464c-7bb4-4da3-b486-18b941be97b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 14:11:47.307356 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:47.308066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:47.316399 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.316862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.318698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:47.319551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:47.614233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:47.624028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:47.625719 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:47.627037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-847307d9-a631-4d56-8bd7-a4be571c00fb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.324049 May 10 14:11:47.627705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 397/817] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:47 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:48.647681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:48.648337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:48.661163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:48.661958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:48.662963 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:48.663641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:49.121070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:49.136474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:49.139153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:49.142900 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4d686daa-b25a-4ad9-826f-f9ff24d351bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.500491 May 10 14:11:49.145320 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 421/818] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:48 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:50.187270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:50.188687 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:50.196568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:50.197277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:50.198281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:50.199105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:50.440195 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:50.449591 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:50.451295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:50.452574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a08bb2dc-1551-48a3-b99b-766b7743b4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.271656 May 10 14:11:50.453245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 398/819] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:50 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:51.480037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:51.481449 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:51.494850 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:51.495361 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:51.496234 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:51.497297 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:51.672301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:51.684048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:51.685762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:51.687207 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9fbafe9c-e355-494f-a40e-d0640d9baf84 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.212004 May 10 14:11:51.688254 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 422/820] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:51 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:52.710464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:52.712395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:52.736624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:52.737196 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:52.738107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:52.738657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:52.960321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:52.976043 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:52.991111 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:52.993602 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ed61ad56-7f3b-4096-ba4b-a8acf7988183 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.290238 May 10 14:11:52.994618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 399/821] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:52 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:54.013641 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:54.014260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:54.021763 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:54.022224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:54.023021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:54.023458 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:54.271345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:54.281322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:54.282841 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:54.285073 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f2119dba-137c-4ff9-8d39-6ccdf48799c6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.275393 May 10 14:11:54.285619 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 423/822] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:54 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:11:55.303057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:55.303764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:55.310363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:55.310901 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:55.311695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:55.312137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:55.444009 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:55.452896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:55.454683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:55.455984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-887c4f28-f687-4746-bf9d-5de871909658 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.156877 May 10 14:11:55.456702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 400/823] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:55 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:56.475706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:56.476318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:56.482593 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:56.483043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:56.483821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:56.484265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:56.642968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:56.652933 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:56.659602 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:56.661238 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-130710b9-cd05-4679-ad58-4607586388bf tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.189979 May 10 14:11:56.665620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 424/824] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:56 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:57.682553 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:57.683198 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:57.696002 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:57.696537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:57.697548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:57.698057 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:57.872668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:57.883048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:57.894536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:57.898103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-12a36954-100b-4e52-8e6c-275bdc7fa480 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.219702 May 10 14:11:57.903191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 401/825] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:57 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:11:58.918864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:11:58.920171 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:11:58.928024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:58.929002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:58.931027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:11:58.931705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:11:59.110963 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:59.119866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:59.121389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:11:59.122583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-21da3dca-f58d-48a5-846b-0ca8a72b4e49 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.207821 May 10 14:11:59.123389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 425/826] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:11:58 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:00.163203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:00.166538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:00.186622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.187281 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.188255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:00.188858 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:00.438773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:00.448948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:00.451012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:00.452320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e99a2a28-cb77-4367-81ae-cd7a754e0f87 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.308918 May 10 14:12:00.452879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 402/827] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:00 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:01.471913 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:01.472508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:01.482838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:01.483809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:01.484855 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:01.485349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:01.631246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:01.643251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:01.643251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:01.643483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-810d8634-6a8c-4bc0-bb22-ea87b9116c0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.175188 May 10 14:12:01.654634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 426/828] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:01 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:02.660819 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:02.662183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:02.668229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:02.668683 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:02.669454 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:02.669887 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:02.800846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:02.810212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:02.811724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:02.812886 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-93b4545d-6856-463f-96f5-c2c160bf663d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.155952 May 10 14:12:02.813452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 403/829] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:02 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:03.832103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:03.832951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:03.840456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:03.841071 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:03.842139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:03.842745 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:03.999225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:04.009068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:04.010618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:04.011802 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-80901500-a970-432f-baea-76d4643828e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.183731 May 10 14:12:04.012345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 427/830] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:03 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:05.029832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:05.030469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:05.037146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:05.037598 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:05.038416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:05.038859 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:05.165391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:05.173565 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:05.175170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:05.176327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-fa2dfe20-b791-42e9-8d66-d08ad1b20b33 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.150387 May 10 14:12:05.176892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 404/831] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:05 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:06.194343 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:06.195049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:06.201517 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:06.202045 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:06.202915 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:06.203439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:06.340769 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:06.351817 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:06.353901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:06.355358 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b813ab01-8400-40cd-bde2-c5ccece8ade8 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.165510 May 10 14:12:06.356135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 428/832] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:06 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:07.373871 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:07.374503 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:07.381391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:07.381838 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:07.382649 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:07.383079 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:07.516744 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:07.525799 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:07.527590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:07.528742 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-16fdc19b-da96-462d-9ef9-293d7d48c2ae tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.158959 May 10 14:12:07.529381 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 405/833] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:07 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:08.548636 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:08.549298 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:08.571193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:08.572355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:08.573325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:08.573982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:08.728328 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:08.738083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:08.740202 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:08.742225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-001b1e44-ad57-449b-8473-a260494f0515 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.198716 May 10 14:12:08.743434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 429/834] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:08 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:09.761238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:09.762715 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:09.769399 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:09.770058 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:09.771798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:09.772468 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:09.947996 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:09.956984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:09.959594 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:09.961023 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a24e4dc1-b2e4-4b83-8e42-4276659421a6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.203927 May 10 14:12:09.962107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 406/835] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:09 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:10.979719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:10.980332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:10.993998 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:10.994486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:10.995498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:10.996103 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:11.153407 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:11.163447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:11.165879 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:11.167609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4295a170-1e0d-456a-b50d-1d8fc81ddb28 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.191778 May 10 14:12:11.171668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 430/836] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:10 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:12.186044 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:12.186711 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:12.193718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:12.194314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:12.195100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:12.195541 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:12.390241 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:12.399132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:12.400632 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:12.401791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-10504dcd-d379-4a9a-bce8-cabee5e26c42 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.220861 May 10 14:12:12.402373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 407/837] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:12 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:13.159608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-0aec32c5-429a-4565-8701-d1fe309f13b4 req-7aefa809-2715-40a2-aef1-065b95b66996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "name": "network-vif-plugged", "status": "completed", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:13.173306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-0aec32c5-429a-4565-8701-d1fe309f13b4 req-7aefa809-2715-40a2-aef1-065b95b66996 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.174043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-0aec32c5-429a-4565-8701-d1fe309f13b4 req-7aefa809-2715-40a2-aef1-065b95b66996 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.191572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-0aec32c5-429a-4565-8701-d1fe309f13b4 req-7aefa809-2715-40a2-aef1-065b95b66996 service nova] Creating event network-vif-plugged:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:12:13.199256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-0aec32c5-429a-4565-8701-d1fe309f13b4 req-7aefa809-2715-40a2-aef1-065b95b66996 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043793 May 10 14:12:13.200008 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 431/838] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:13.420647 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:13.421428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:13.428755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.429215 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.430004 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:13.430479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:13.569728 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:13.579593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:13.581017 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:13.582283 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-aa788d2f-09ac-43a9-b561-b8e4c434b959 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.165504 May 10 14:12:13.583487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 408/839] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:13 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:14.306965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1497925456", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "networks": [{"uuid": "6b8e03f0-d737-44f8-b409-295351c0bde4"}]}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:14.361405 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] validate_networks() for [('6b8e03f0-d737-44f8-b409-295351c0bde4', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:12:14.601953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:14.602813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:14.609594 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.610108 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.610852 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.611470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.767254 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:12:14.767832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:12:14.773674 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:12:14.774810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:12:14.775510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:12:14.788740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.789351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.790143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:14.790626 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:14.813122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Getting quotas for project 41c12a4697c94557a7033e2af0d32d19. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:12:14.817451 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Getting quotas for user 64b583f2a49f47c1ab91330e2d32f8f1 and project 41c12a4697c94557a7033e2af0d32d19. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:12:14.829827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:12:14.834838 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:12:14.853597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:14.868531 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:14.870128 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:14.871423 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cda671f1-ab52-4cf4-a8f5-804a37d03720 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.274370 May 10 14:12:14.872778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 409/840] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:14 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:12:14.888078 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d2e2fac1-18be-4e22-b76a-7b3b948c74e8 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586611 May 10 14:12:14.889685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 432/841] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:12:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:12:14.901442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-04f3097b-7191-4fbf-b1a2-a7e0790a77db tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:14.902953 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-04f3097b-7191-4fbf-b1a2-a7e0790a77db tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:14.962299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-04f3097b-7191-4fbf-b1a2-a7e0790a77db tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:14.969862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-04f3097b-7191-4fbf-b1a2-a7e0790a77db tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1214 microversion: 2.1 time: 0.073993 May 10 14:12:14.970774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 410/842] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:14 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:15.891145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:15.891727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:15.898612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:15.898973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:15.899733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:15.900168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:15.987529 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:15.990314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:16.005294 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:16.006383 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:16.008208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:16.009497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:16.079883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:16.091302 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:16.093791 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:16.095174 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-897a3ee7-0d8f-42c2-8329-067def7b7625 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1810 microversion: 2.20 time: 0.208671 May 10 14:12:16.095985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 433/843] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:15 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:12:16.176790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:16.188083 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bb62aef4-4155-47e0-8d8e-ade9aea7f415 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1274 microversion: 2.1 time: 0.204659 May 10 14:12:16.188723 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 411/844] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:15 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1274 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:17.116864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:17.117545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:17.124892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:17.125657 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:17.126677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:17.127042 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:17.206485 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:17.207025 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:17.215335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:17.215864 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:17.216956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:17.217607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:17.292842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:17.301876 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:17.303618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:17.305190 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-31d08ed6-adf2-446d-878c-17d1cdd8a0d9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1797 microversion: 2.20 time: 0.193019 May 10 14:12:17.305866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 434/845] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:12:17 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1797 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:12:17.489240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:17.496560 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0c20b77d-f7e8-44ab-a3d0-215e8c30fc29 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.294559 May 10 14:12:17.497133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 412/846] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:17 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:17.823824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-55691b99-c1a2-4e43-a8f0-90090df1d03f req-34ec46fb-fc33-4977-a99a-8593743e1654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd83d27b-3331-4e10-8c64-a7bf8291cb9e", "tag": "bcc11d5d-3ee4-4932-af11-3f2e6c69fb92"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:17.833758 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-55691b99-c1a2-4e43-a8f0-90090df1d03f req-34ec46fb-fc33-4977-a99a-8593743e1654 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:17.834231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-55691b99-c1a2-4e43-a8f0-90090df1d03f req-34ec46fb-fc33-4977-a99a-8593743e1654 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:17.845673 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-55691b99-c1a2-4e43-a8f0-90090df1d03f req-34ec46fb-fc33-4977-a99a-8593743e1654 service nova] Creating event network-changed:bcc11d5d-3ee4-4932-af11-3f2e6c69fb92 for instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e on hv-cinder-83588 May 10 14:12:17.850484 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-55691b99-c1a2-4e43-a8f0-90090df1d03f req-34ec46fb-fc33-4977-a99a-8593743e1654 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030180 May 10 14:12:17.857180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 435/847] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:18.514593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:18.515200 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:18.522608 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:18.523059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:18.523816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:18.524251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:18.650992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:18.658272 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a8a3a7c8-a7a6-4602-bc5f-5529ffef261c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.147516 May 10 14:12:18.658846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 413/848] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:18 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:19.676048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:19.676868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:19.684203 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:19.684657 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:19.685447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:19.685887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:19.816792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:19.824149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c1d1ec0f-63f2-4df7-aa0a-e57c630abb9d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.152861 May 10 14:12:19.824702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 436/849] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:19 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:20.841456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:20.842075 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:20.848449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:20.848903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:20.849736 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:20.850481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:21.089179 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:21.097203 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8fa869a0-958b-4456-ba34-736d979d14a4 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.259496 May 10 14:12:21.098003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 414/850] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:20 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:22.120521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:22.121425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:22.127806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:22.128256 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:22.129020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:22.129455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:22.264696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:22.272893 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-91dd6442-48ba-4530-8e64-059bf850bb6e tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.158818 May 10 14:12:22.273465 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 437/851] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:22 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:23.174377 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-adb4e3ba-3d9d-4b33-b509-007f73512a1b req-870fdca1-e8f1-42f4-ad84-deedd6edccfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd83d27b-3331-4e10-8c64-a7bf8291cb9e", "name": "network-vif-plugged", "status": "completed", "tag": "bcc11d5d-3ee4-4932-af11-3f2e6c69fb92"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:23.185094 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-adb4e3ba-3d9d-4b33-b509-007f73512a1b req-870fdca1-e8f1-42f4-ad84-deedd6edccfc service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:23.185545 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-adb4e3ba-3d9d-4b33-b509-007f73512a1b req-870fdca1-e8f1-42f4-ad84-deedd6edccfc service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:23.198017 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-adb4e3ba-3d9d-4b33-b509-007f73512a1b req-870fdca1-e8f1-42f4-ad84-deedd6edccfc service nova] Creating event network-vif-plugged:bcc11d5d-3ee4-4932-af11-3f2e6c69fb92 for instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e on hv-cinder-83588 May 10 14:12:23.203202 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-adb4e3ba-3d9d-4b33-b509-007f73512a1b req-870fdca1-e8f1-42f4-ad84-deedd6edccfc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032336 May 10 14:12:23.203803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 415/852] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:23.296633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:23.297286 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:23.304731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:23.305193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:23.305979 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:23.306451 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:23.439110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:23.446455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-76b98c90-61c5-468f-ab89-f1c33aac1b11 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.154364 May 10 14:12:23.447031 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 438/853] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:23 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:24.465581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:24.466328 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:24.472995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:24.473455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:24.474256 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:24.475335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:24.610445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:24.618327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b75d5c89-ab4b-467c-820d-4627b9476602 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1314 microversion: 2.1 time: 0.157647 May 10 14:12:24.618906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 416/854] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:24 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:25.635739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:25.636356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:25.642703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:25.643163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:25.643925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:25.644363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:25.776616 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:25.784252 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0b5315c2-9f1d-4463-b18b-4ccfc4018281 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1498 microversion: 2.1 time: 0.153103 May 10 14:12:25.784832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 439/855] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:25 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:26.216505 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:26.217548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:26.224287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:26.224735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:26.225576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:26.226704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:26.251433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:12:26.324358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-34e96453-bc2b-4aad-8c57-cad8ff5f3f6c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 204 len: 0 microversion: 2.1 time: 0.111503 May 10 14:12:26.324943 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 417/856] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:12:26 2022] DELETE /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:12:26.333304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:26.334005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:26.342691 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:26.345416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:26.346436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:26.346901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:26.479380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:26.486799 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-33baf8c0-c8d8-47b0-beb3-7299d54cfb32 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1504 microversion: 2.1 time: 0.157442 May 10 14:12:26.487370 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 440/857] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:26 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:27.505056 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:27.505826 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:27.512159 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:27.512616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:27.513389 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:27.513831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:27.641757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:27.649085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ffe2edf8-6831-4600-916f-6537f641e318 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1504 microversion: 2.1 time: 0.148199 May 10 14:12:27.649660 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 418/858] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:27 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:28.331492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-f131ded8-2cbc-48d8-a3fd-14fb52875790 req-c9850295-4679-4a4b-91fb-413383386978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd83d27b-3331-4e10-8c64-a7bf8291cb9e", "name": "network-vif-deleted", "tag": "bcc11d5d-3ee4-4932-af11-3f2e6c69fb92"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:28.343130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-f131ded8-2cbc-48d8-a3fd-14fb52875790 req-c9850295-4679-4a4b-91fb-413383386978 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:28.343857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-f131ded8-2cbc-48d8-a3fd-14fb52875790 req-c9850295-4679-4a4b-91fb-413383386978 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:28.356153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-f131ded8-2cbc-48d8-a3fd-14fb52875790 req-c9850295-4679-4a4b-91fb-413383386978 service nova] Creating event network-vif-deleted:bcc11d5d-3ee4-4932-af11-3f2e6c69fb92 for instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e on hv-cinder-83588 May 10 14:12:28.361223 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-f131ded8-2cbc-48d8-a3fd-14fb52875790 req-c9850295-4679-4a4b-91fb-413383386978 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033995 May 10 14:12:28.361918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 441/859] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:28.666331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:28.666942 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:28.673284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:28.673764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:28.674586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:28.675021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:28.706089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:28.706566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:28.707007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lazy-loading 'fault' on Instance uuid bd83d27b-3331-4e10-8c64-a7bf8291cb9e {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:12:28.749227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:28.756562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-fd90a294-7eaf-48a5-bb0a-290843ad5a23 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 200 len: 1304 microversion: 2.1 time: 0.094573 May 10 14:12:28.757065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 419/860] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:28 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:29.774686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:29.775395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: bd83d27b-3331-4e10-8c64-a7bf8291cb9e] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:29.781586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:29.781973 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:29.782762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:29.783194 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:29.796088 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] HTTP exception thrown: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Request method failure captured: May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e HTTP/1.1 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienK8fBjujDSKK4HQuOCXxOALkGnFQSH-V5fsDvBDM2pHn_A9D-T-_863smFhiCkY_0kKxACKZ_sKqUJP2ulOEUnt4zsY37I6-HP1rXXIAbjvYMxqDbIwnxNot6mQwI7d8gRCTETaW5Vjs_qP2pnxIYmZsAulXYyR15iQJ3Y1sW8dWyw May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 41c12a4697c94557a7033e2af0d32d19 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-VolumesActionsTest-1990201908 May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:12:29.797666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41c12a4697c94557a7033e2af0d32d19", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-VolumesActionsTest-1990201908 May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 41c12a4697c94557a7033e2af0d32d19 May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-VolumesActionsTest-1990201908 May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-VolumesActionsTest-1990201908-project May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 64b583f2a49f47c1ab91330e2d32f8f1 May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-VolumesActionsTest-1990201908-project May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. May 10 14:12:29.799356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'bd83d27b-3331-4e10-8c64-a7bf8291cb9e'} May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:12:29.800369 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. May 10 14:12:29.801906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:12:29.803126 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Returning 404 to user: Instance bd83d27b-3331-4e10-8c64-a7bf8291cb9e could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:12:29.803126 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5739f950-f72c-44cc-a586-5523f4a2235c tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e" status: 404 len: 111 microversion: 2.1 time: 0.029981 May 10 14:12:29.803126 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 442/861] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:29 2022] GET /compute/v2.1/servers/bd83d27b-3331-4e10-8c64-a7bf8291cb9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:12:29.893298 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-99896530", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "networks": [{"uuid": "6b8e03f0-d737-44f8-b409-295351c0bde4"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:29.943146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] validate_networks() for [('6b8e03f0-d737-44f8-b409-295351c0bde4', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:12:30.288092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:12:30.288537 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:12:30.289123 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:12:30.289557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:12:30.289970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:12:30.298709 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:30.299093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:30.299886 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:30.300317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:30.316760 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Getting quotas for project 41c12a4697c94557a7033e2af0d32d19. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:12:30.321267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Getting quotas for user 64b583f2a49f47c1ab91330e2d32f8f1 and project 41c12a4697c94557a7033e2af0d32d19. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:12:30.333231 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:12:30.335544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:12:30.383206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-83386ef3-3cfd-478c-9ff8-ec198662597d tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493720 May 10 14:12:30.383876 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 420/862] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:12:30.393917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-2f5420c5-d6d6-41df-97db-436894a8c197 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:30.394564 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-2f5420c5-d6d6-41df-97db-436894a8c197 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:30.446596 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-2f5420c5-d6d6-41df-97db-436894a8c197 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:30.453198 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-2f5420c5-d6d6-41df-97db-436894a8c197 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1212 microversion: 2.1 time: 0.063378 May 10 14:12:30.453765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 443/863] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:30 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1212 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:31.470744 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:31.471365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:31.481361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:31.481820 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:31.482674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:31.483141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:31.553688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:31.561849 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c3e37adf-0a69-48db-b338-a6de2c406186 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1270 microversion: 2.1 time: 0.094961 May 10 14:12:31.562562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 421/864] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:31 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:32.515425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-708dc7f9-262e-4161-bfe2-5a02c97f71fb req-541078e2-91e8-4f38-b789-197fc3e27be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa5f192-32d1-498a-911b-9f0d660e342a", "tag": "f7124be4-99ab-4ba6-a1cc-39b8f19f08bc"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:32.524717 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-708dc7f9-262e-4161-bfe2-5a02c97f71fb req-541078e2-91e8-4f38-b789-197fc3e27be3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:32.525162 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-708dc7f9-262e-4161-bfe2-5a02c97f71fb req-541078e2-91e8-4f38-b789-197fc3e27be3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:32.535396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-708dc7f9-262e-4161-bfe2-5a02c97f71fb req-541078e2-91e8-4f38-b789-197fc3e27be3 service nova] Creating event network-changed:f7124be4-99ab-4ba6-a1cc-39b8f19f08bc for instance 1fa5f192-32d1-498a-911b-9f0d660e342a on hv-cinder-83588 May 10 14:12:32.540877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-708dc7f9-262e-4161-bfe2-5a02c97f71fb req-541078e2-91e8-4f38-b789-197fc3e27be3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029192 May 10 14:12:32.541466 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 444/865] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:12:32.580524 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:32.581192 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:32.587902 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:32.588352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:32.589136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:32.589591 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:32.813895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:32.821551 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5e533b4b-c70b-484c-882c-4a1fae4e1ac9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.245752 May 10 14:12:32.822236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 422/866] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:32 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:33.838948 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:33.839648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:33.845821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:33.846294 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:33.847060 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:33.847499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:33.976181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:33.983371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-21a82841-c0d0-4fa5-8e81-bb1c638c1fd9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.149243 May 10 14:12:33.983936 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 445/867] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:33 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:35.000980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:35.001601 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:35.008001 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:35.008455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:35.009268 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:35.010396 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:35.142488 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:35.149784 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dade3ebd-f348-4381-96db-d97d446d7fb5 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.152908 May 10 14:12:35.151379 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 423/868] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:34 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:36.168242 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:36.168870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:36.175245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:36.175698 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:36.176467 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:36.176907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:36.303703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:36.310985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-dc7ad2d7-092a-44ea-b0c4-0ff830b22de6 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.147468 May 10 14:12:36.311541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 446/869] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:36 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:37.327288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:37.327828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:37.334218 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:37.334677 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:37.335444 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:37.335883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:37.463208 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:37.470356 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cde0ea24-199a-4dcb-a84a-ed018d554cdf tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.146967 May 10 14:12:37.470918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 424/870] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:37 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:38.487521 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:38.488132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:38.495120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:38.495549 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:38.496318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:38.496767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:38.626310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:38.633809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bfbcba2c-44fa-40ae-a25d-20b3a1d96fff tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.150434 May 10 14:12:38.635059 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 447/871] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:38 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:39.652174 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:39.652818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:39.659220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:39.659675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:39.660445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:39.660891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:39.784933 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:39.792740 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9a74afd0-0327-4d10-888d-86ebeb9a0319 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.145178 May 10 14:12:39.793320 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 425/872] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:39 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:40.809562 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:40.810798 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:40.816670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:40.817122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:40.817891 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:40.818359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:40.937645 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-a965093c-158a-4a67-9ef5-ac166b8b42f1 req-8c838677-9da8-4672-8d5e-e6d05a0699e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa5f192-32d1-498a-911b-9f0d660e342a", "name": "network-vif-plugged", "status": "completed", "tag": "f7124be4-99ab-4ba6-a1cc-39b8f19f08bc"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:40.946071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-a965093c-158a-4a67-9ef5-ac166b8b42f1 req-8c838677-9da8-4672-8d5e-e6d05a0699e5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:40.946568 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-a965093c-158a-4a67-9ef5-ac166b8b42f1 req-8c838677-9da8-4672-8d5e-e6d05a0699e5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:40.954445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:40.958566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-a965093c-158a-4a67-9ef5-ac166b8b42f1 req-8c838677-9da8-4672-8d5e-e6d05a0699e5 service nova] Creating event network-vif-plugged:f7124be4-99ab-4ba6-a1cc-39b8f19f08bc for instance 1fa5f192-32d1-498a-911b-9f0d660e342a on hv-cinder-83588 May 10 14:12:40.962149 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a374e99f-3447-4f39-9c21-2e901eb268f9 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.157169 May 10 14:12:40.963525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-a965093c-158a-4a67-9ef5-ac166b8b42f1 req-8c838677-9da8-4672-8d5e-e6d05a0699e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030099 May 10 14:12:40.963666 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 448/873] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:40 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:40.964506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 426/874] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:12:41.980120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:41.980731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:41.987147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:41.987607 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:41.988382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:41.988823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:42.123999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:42.131202 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d9c2a6fe-62b6-4c7e-bd01-cfe88f905c2a tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.155200 May 10 14:12:42.131754 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 449/875] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:41 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:43.149978 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:43.150831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:43.156962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:43.157412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:43.158180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:43.158715 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:43.285909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:43.293965 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f2abd35a-a203-4ba0-9de0-a2bb47efb3c7 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.148866 May 10 14:12:43.294577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 427/876] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:43 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:44.311566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:44.312104 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:44.318452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:44.318902 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:44.319700 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:44.320136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:44.450157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:44.457857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-413d0376-32d8-4874-b888-28acb5447f28 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1312 microversion: 2.1 time: 0.150131 May 10 14:12:44.458712 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 450/877] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:44 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:45.475204 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:45.475821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:45.483519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:45.483971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:45.484738 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:45.485494 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:45.613266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:45.621433 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e884eb16-9b09-46dc-86aa-4ff11b013982 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1497 microversion: 2.1 time: 0.150124 May 10 14:12:45.621997 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 428/878] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:45 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:47.301127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:47.301665 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:47.308136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:47.308592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:47.309371 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:47.309816 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:47.335236 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:12:47.410834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cfea3264-dd1e-420a-a764-3a5561acf915 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 204 len: 0 microversion: 2.1 time: 0.113019 May 10 14:12:47.411662 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 451/879] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:12:47 2022] DELETE /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:12:47.420839 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:47.421496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:47.428132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:47.428585 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:47.429404 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:47.429870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:47.560241 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:47.567589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-728f383c-a296-4ca8-a594-0968e4ccfe47 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1503 microversion: 2.1 time: 0.150699 May 10 14:12:47.568162 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 429/880] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:47 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:48.585821 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:48.586557 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:48.594076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:48.595977 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:48.596773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:48.597439 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:48.740501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:48.749104 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cea90f3a-c191-4cfe-88bf-7e958977f545 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1503 microversion: 2.1 time: 0.167591 May 10 14:12:48.749671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 452/881] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:48 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:12:49.531817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-dceadff1-7e60-4f59-8cbe-a6b52dbcc4e3 req-839ebdf8-f9c3-4193-809f-f0df4b2e4b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa5f192-32d1-498a-911b-9f0d660e342a", "name": "network-vif-deleted", "tag": "f7124be4-99ab-4ba6-a1cc-39b8f19f08bc"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:12:49.539649 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-dceadff1-7e60-4f59-8cbe-a6b52dbcc4e3 req-839ebdf8-f9c3-4193-809f-f0df4b2e4b05 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:49.540097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-dceadff1-7e60-4f59-8cbe-a6b52dbcc4e3 req-839ebdf8-f9c3-4193-809f-f0df4b2e4b05 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:49.551149 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-dceadff1-7e60-4f59-8cbe-a6b52dbcc4e3 req-839ebdf8-f9c3-4193-809f-f0df4b2e4b05 service nova] Creating event network-vif-deleted:f7124be4-99ab-4ba6-a1cc-39b8f19f08bc for instance 1fa5f192-32d1-498a-911b-9f0d660e342a on hv-cinder-83588 May 10 14:12:49.556264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-dceadff1-7e60-4f59-8cbe-a6b52dbcc4e3 req-839ebdf8-f9c3-4193-809f-f0df4b2e4b05 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156543 May 10 14:12:49.556862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 430/882] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:12:49.766550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:49.767178 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:49.774322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:49.775298 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:49.776261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:49.776702 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:49.809932 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:49.810417 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:49.810863 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lazy-loading 'fault' on Instance uuid 1fa5f192-32d1-498a-911b-9f0d660e342a {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:12:49.851842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64b583f2a49f47c1ab91330e2d32f8f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41c12a4697c94557a7033e2af0d32d19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:12:49.859880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-747cbc26-63e3-491f-aa56-57a58d197e16 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 200 len: 1302 microversion: 2.1 time: 0.097677 May 10 14:12:49.860451 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 453/883] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:49 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:12:50.878550 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:12:50.879258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] [instance: 1fa5f192-32d1-498a-911b-9f0d660e342a] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:12:50.886366 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:50.886830 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:50.887618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:12:50.888070 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:12:50.902614 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] HTTP exception thrown: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Request method failure captured: May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a HTTP/1.1 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienK8fBjujDSKK4HQuOCXxOALkGnFQSH-V5fsDvBDM2pHn_A9D-T-_863smFhiCkY_0kKxACKZ_sKqUJP2ulOEUnt4zsY37I6-HP1rXXIAbjvYMxqDbIwnxNot6mQwI7d8gRCTETaW5Vjs_qP2pnxIYmZsAulXYyR15iQJ3Y1sW8dWyw May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 41c12a4697c94557a7033e2af0d32d19 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-VolumesActionsTest-1990201908 May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:12:50.904257 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/41c12a4697c94557a7033e2af0d32d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_41c12a4697c94557a7033e2af0d32d19", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-VolumesActionsTest-1990201908 May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 41c12a4697c94557a7033e2af0d32d19 May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-VolumesActionsTest-1990201908 May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-VolumesActionsTest-1990201908-project May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 64b583f2a49f47c1ab91330e2d32f8f1 May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-VolumesActionsTest-1990201908-project May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. May 10 14:12:50.905766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '1fa5f192-32d1-498a-911b-9f0d660e342a'} May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:12:50.906605 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. May 10 14:12:50.908292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:12:50.909803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] Returning 404 to user: Instance 1fa5f192-32d1-498a-911b-9f0d660e342a could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:12:50.909803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f4b662af-a1ab-4e4b-a29c-cce299bc9150 tempest-VolumesActionsTest-1990201908 tempest-VolumesActionsTest-1990201908-project] 10.222.0.32 "GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a" status: 404 len: 111 microversion: 2.1 time: 0.032206 May 10 14:12:50.909803 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 431/884] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:12:50 2022] GET /compute/v2.1/servers/1fa5f192-32d1-498a-911b-9f0d660e342a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:13:18.019963 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5577fcda-eb9a-4211-8350-828abe081d60 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Action: 'create', calling method: .version_select at 0x7efd560d7040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2102038041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGVgaOX1k/mNS+zi8512A8hNUPgvcEY757+bIOVHMLzPqtyB/nGGwB3ENe/Z30mzgUFFyc97OmlEAztsUWkPvPJgcThSs85hPkLfoTcKNnOzztbkvotUXOtpNUq+IT4mCQ=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:18.052533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-5577fcda-eb9a-4211-8350-828abe081d60 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for project 6350c410027a478988e364b17696da95. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:13:18.058508 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-5577fcda-eb9a-4211-8350-828abe081d60 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for user da9685af6f6f47c8a59fb93df9bd0ec1 and project 6350c410027a478988e364b17696da95. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:13:18.100962 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5577fcda-eb9a-4211-8350-828abe081d60 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.404039 May 10 14:13:18.107524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 454/885] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:13:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:28.003003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:28.003587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:28.010429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.010885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.011663 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.012101 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.041620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6e181b8c-7e91-4e7a-ad67-b421aaa5110d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments/650ef6b0-5828-4712-8c56-5685ee431277" status: 200 len: 194 microversion: 2.20 time: 0.043116 May 10 14:13:28.042222 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 432/886] 10.222.0.32 () {60 vars in 1453 bytes} [Tue May 10 14:13:27 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments/650ef6b0-5828-4712-8c56-5685ee431277 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:13:28.104736 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:28.105233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:28.111285 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.111740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.112515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.112955 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.195216 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lazy-loading 'services' on Instance uuid 32252988-f2bf-4e25-adfe-fcc8ea12528d {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:13:28.264889 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b8019e10-6feb-4881-b32a-d6b23147f868 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments/650ef6b0-5828-4712-8c56-5685ee431277" status: 202 len: 0 microversion: 2.20 time: 0.164934 May 10 14:13:28.265483 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 455/887] 10.222.0.32 () {60 vars in 1456 bytes} [Tue May 10 14:13:28 2022] DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments/650ef6b0-5828-4712-8c56-5685ee431277 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:13:28.273900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:28.274950 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:28.281556 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.282025 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.283042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:28.283486 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:28.314856 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c510eb5e-05ff-4b4e-95d3-8af55fd99da5 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044947 May 10 14:13:28.315412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 433/888] 10.222.0.32 () {60 vars in 1342 bytes} [Tue May 10 14:13:28 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:13:29.327727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:29.328660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:29.335038 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.335493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.336281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.336726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.366331 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-677036ac-fd3b-4383-bbb9-f85bf4ba600a tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044124 May 10 14:13:29.366887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 456/889] 10.222.0.32 () {60 vars in 1342 bytes} [Tue May 10 14:13:29 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:29.423113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:29.423615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:29.430087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.430583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.432361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.432808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.463448 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:13:29.543465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1fb206e4-238a-4e6e-94a4-93503d3a81bc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 204 len: 0 microversion: 2.20 time: 0.123732 May 10 14:13:29.544107 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 434/890] 10.222.0.32 () {60 vars in 1279 bytes} [Tue May 10 14:13:29 2022] DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:13:29.554505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:29.555111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:29.561830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.562314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.563080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:29.563519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:29.705041 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:29.713189 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:29.714746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:29.715901 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3c8b15b5-1676-4168-9769-ff5ea2af17b1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.165523 May 10 14:13:29.716461 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 457/891] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:29 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:13:30.735412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:30.736194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:30.742562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:30.743017 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:30.743793 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:30.744236 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:30.882690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:30.890725 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:30.892243 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:30.893406 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6503c8e5-e531-498f-88c8-34f381b678f9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1725 microversion: 2.20 time: 0.162498 May 10 14:13:30.893970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 435/892] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:30 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:31.912650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:31.913272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:31.920315 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:31.920768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:31.921768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:31.922221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:31.990780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:31.999820 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:32.002845 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:32.014188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9b669a0c-c072-43f1-9332-3b9add26f22f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 200 len: 1658 microversion: 2.20 time: 0.105337 May 10 14:13:32.021394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 458/893] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:31 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 1658 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:32.311995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-6f635f6c-95d3-4166-98a7-eee2260a76ad req-d335543b-66e7-44b8-8742-4da34f8bfdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32252988-f2bf-4e25-adfe-fcc8ea12528d", "name": "network-vif-deleted", "tag": "2666c4c9-5286-4f42-8256-74a56001c647"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:32.321439 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-6f635f6c-95d3-4166-98a7-eee2260a76ad req-d335543b-66e7-44b8-8742-4da34f8bfdd9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:32.322140 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-6f635f6c-95d3-4166-98a7-eee2260a76ad req-d335543b-66e7-44b8-8742-4da34f8bfdd9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:32.338085 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-6f635f6c-95d3-4166-98a7-eee2260a76ad req-d335543b-66e7-44b8-8742-4da34f8bfdd9 service nova] Creating event network-vif-deleted:2666c4c9-5286-4f42-8256-74a56001c647 for instance 32252988-f2bf-4e25-adfe-fcc8ea12528d on hv-cinder-83588 May 10 14:13:32.344656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-6f635f6c-95d3-4166-98a7-eee2260a76ad req-d335543b-66e7-44b8-8742-4da34f8bfdd9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036187 May 10 14:13:32.345906 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 436/894] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:33.033017 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:33.033631 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:33.039899 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:33.040345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:33.041117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:33.042394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:33.055650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d HTTP/1.1 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:13:33.057471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:13:33.059258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '32252988-f2bf-4e25-adfe-fcc8ea12528d'} May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:13:33.060158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:13:33.061703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:13:33.063435 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:13:33.063435 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4ff4735c-4883-42bb-a8e3-65bb255d8390 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 404 len: 111 microversion: 2.20 time: 0.029952 May 10 14:13:33.063435 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 459/895] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:33 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:13:33.068331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6879fd3d-f6ad-4a7f-b5d0-dae34f2b5fe6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '.version_select at 0x7efd56134820>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:33.086050 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6879fd3d-f6ad-4a7f-b5d0-dae34f2b5fe6 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984660144" status: 204 len: 0 microversion: 2.20 time: 0.021912 May 10 14:13:33.086688 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 437/896] 10.222.0.32 () {60 vars in 1261 bytes} [Tue May 10 14:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1984660144 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:13:33.737025 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7537e6e9-0565-4610-a8ba-8d1f347ea6f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: .version_select at 0x7efd560b0040>, body: {"keypair": {"name": "tempest-keypair-860653310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwhFOI/YG1xtaHRhrVn38oTAwaWL/oIAMalOTVVb8R+Tf5jr006VM5vPp9lLgCI5E6ZSqXkFdf/9mQf7SvKU+uK6l5Bq+OofyyTmQPiRV+7zk2ojk7pMEJptypen+mXLw=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:33.752219 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-7537e6e9-0565-4610-a8ba-8d1f347ea6f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for project c251b9c401c6455da95be74c9119b8d2. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:13:33.756023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-7537e6e9-0565-4610-a8ba-8d1f347ea6f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for user 3069e17bfc5d4e34ab7f5c61f48d9f11 and project c251b9c401c6455da95be74c9119b8d2. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:13:33.778221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7537e6e9-0565-4610-a8ba-8d1f347ea6f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045145 May 10 14:13:33.778825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 460/897] 10.222.0.32 () {62 vars in 1199 bytes} [Tue May 10 14:13:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 14:13:35.097705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1826021418", "imageRef": "a18583dd-776e-4247-aebf-63b4d051c39f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a8e69b7-4e90-4197-9be6-027007b12991"}], "security_groups": [{"name": "tempest-securitygroup--576526706"}], "key_name": "tempest-keypair-860653310", "user_data": "}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:35.197247 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] validate_networks() for [('7a8e69b7-4e90-4197-9be6-027007b12991', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:13:35.703089 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:13:35.703515 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:13:35.703992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:13:35.704409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:13:35.705006 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:13:35.715648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:35.716096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:35.716929 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:35.717367 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:35.734249 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for project c251b9c401c6455da95be74c9119b8d2. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:13:35.738051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Getting quotas for user 3069e17bfc5d4e34ab7f5c61f48d9f11 and project c251b9c401c6455da95be74c9119b8d2. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:13:35.750238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:13:35.752540 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a18583dd-776e-4247-aebf-63b4d051c39f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:13:35.799453 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-01c227a5-7ec3-4fe1-b51f-29927658c142 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.707108 May 10 14:13:35.800351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 438/898] 10.222.0.32 () {62 vars in 1187 bytes} [Tue May 10 14:13:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 14:13:35.811255 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:35.811866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:35.870074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:35.880062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:35.881637 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:35.882780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a713092a-9264-404e-a823-957bb6156cbd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1281 microversion: 2.20 time: 0.076050 May 10 14:13:35.883361 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 461/899] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:35 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:36.902029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:36.903290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:36.910816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:36.911277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:36.912097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:36.912544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:36.982833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:36.991251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:36.992751 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:36.993855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8431f8c9-baef-4899-bb81-cb531af6df7f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1351 microversion: 2.20 time: 0.096794 May 10 14:13:36.994459 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 439/900] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:36 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:38.013055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:38.013942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:38.021175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:38.021747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:38.022577 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:38.023021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:38.176689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:38.185024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:38.186573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:38.187881 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f54207e4-8d24-4431-99c2-7944257ee10e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.179686 May 10 14:13:38.188592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 462/901] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:38 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:38.255565 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-66e6c116-75fd-4958-a987-d4cdadf7ccd3 req-152dc5dd-9f8b-449e-8826-5e80b44f38ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:38.269627 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-66e6c116-75fd-4958-a987-d4cdadf7ccd3 req-152dc5dd-9f8b-449e-8826-5e80b44f38ec service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:38.269980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-66e6c116-75fd-4958-a987-d4cdadf7ccd3 req-152dc5dd-9f8b-449e-8826-5e80b44f38ec service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:38.282807 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-66e6c116-75fd-4958-a987-d4cdadf7ccd3 req-152dc5dd-9f8b-449e-8826-5e80b44f38ec service nova] Creating event network-changed:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:13:38.288132 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-66e6c116-75fd-4958-a987-d4cdadf7ccd3 req-152dc5dd-9f8b-449e-8826-5e80b44f38ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038091 May 10 14:13:38.288741 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 440/902] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:39.208773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:39.209386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:39.216043 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:39.216498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:39.217274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:39.217714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:39.346165 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:39.354611 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:39.356252 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:39.357354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-599f2851-72a0-4905-97f2-285ecc63bd7c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.152549 May 10 14:13:39.357907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 463/903] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:39 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:40.376348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:40.377005 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:40.383204 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:40.383657 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:40.384420 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:40.384861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:40.513998 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:40.522589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:40.524543 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:40.525643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-025c46e9-0390-4012-b699-4bf34445e166 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.155084 May 10 14:13:40.526230 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 441/904] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:40 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:41.542767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:41.543448 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:41.549661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:41.550118 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:41.550925 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:41.551368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:41.680707 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:41.689306 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:41.690855 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:41.691969 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-598de6ac-9d86-4d71-8891-9d028ecb75f7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.153140 May 10 14:13:41.692537 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 464/905] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:41 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:42.710220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:42.710855 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:42.718059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:42.718548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:42.719322 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:42.719763 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:42.847019 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:42.854817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:42.857021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:42.858620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e31d7164-c59a-4167-9bda-1ba4187eef1e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.152171 May 10 14:13:42.859578 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 442/906] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:42 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:43.877303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:43.877930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:43.884334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:43.884796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:43.885567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:43.886013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:44.017924 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:44.026056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:44.027669 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:44.029345 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-beed7719-9ccb-454b-b75d-7e7c1a8dd517 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.156469 May 10 14:13:44.029912 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 465/907] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:43 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:44.746415 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-02e81478-b6f8-4d21-8d95-df2217377910 req-3919f5d1-f55d-4a06-8cd7-18689a091028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "name": "network-vif-plugged", "status": "completed", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:44.754527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-02e81478-b6f8-4d21-8d95-df2217377910 req-3919f5d1-f55d-4a06-8cd7-18689a091028 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:44.754961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-02e81478-b6f8-4d21-8d95-df2217377910 req-3919f5d1-f55d-4a06-8cd7-18689a091028 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:44.766245 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-02e81478-b6f8-4d21-8d95-df2217377910 req-3919f5d1-f55d-4a06-8cd7-18689a091028 service nova] Creating event network-vif-plugged:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:13:44.771297 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-02e81478-b6f8-4d21-8d95-df2217377910 req-3919f5d1-f55d-4a06-8cd7-18689a091028 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144975 May 10 14:13:44.772274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 443/908] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:45.046431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:45.047066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:45.053377 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:45.053826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:45.054626 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:45.055066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:45.184053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:45.192627 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:45.194181 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:45.195253 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cf39f658-05fe-4620-915b-86d851c0c688 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.152974 May 10 14:13:45.195809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 466/909] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:45 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:46.214073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:46.214801 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:46.221048 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:46.221498 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:46.222295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:46.222735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:46.350764 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:46.359577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:46.361028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:46.362130 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-205a8449-949c-4e2d-b099-bee35d99351e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1406 microversion: 2.20 time: 0.152771 May 10 14:13:46.362722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 444/910] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:46 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:13:47.380216 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:47.380826 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:47.387111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:47.388154 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:47.388903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:47.389337 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:47.518850 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:47.526567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:47.528079 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:47.529354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e6016b21-21ec-4553-9afd-167dd9c3fc4f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1599 microversion: 2.20 time: 0.153044 May 10 14:13:47.529912 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 467/911] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:13:47 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:13:47.546920 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:47.547509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:47.553853 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:47.554337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:47.555163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:47.555598 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:47.795183 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-12e6ade4-a04f-4a62-bacb-c2354b454ec0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.252723 May 10 14:13:47.795788 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 445/912] 10.222.0.32 () {60 vars in 1315 bytes} [Tue May 10 14:13:47 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-interface => generated 285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:13:49.041640 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-d9d87a8c-8f80-40ff-9c42-70232ffa57aa req-339a4194-f4c1-40b4-8d0a-8b70c0885500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:49.051570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d9d87a8c-8f80-40ff-9c42-70232ffa57aa req-339a4194-f4c1-40b4-8d0a-8b70c0885500 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:49.051874 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-d9d87a8c-8f80-40ff-9c42-70232ffa57aa req-339a4194-f4c1-40b4-8d0a-8b70c0885500 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:49.066088 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-d9d87a8c-8f80-40ff-9c42-70232ffa57aa req-339a4194-f4c1-40b4-8d0a-8b70c0885500 service nova] Creating event network-changed:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:13:49.072139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-d9d87a8c-8f80-40ff-9c42-70232ffa57aa req-339a4194-f4c1-40b4-8d0a-8b70c0885500 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033957 May 10 14:13:49.072677 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 468/913] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:13:49.240250 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1899071277", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102038041", "security_groups": [{"name": "tempest-secgroup-smoke-153034832"}], "block_device_mapping_v2": [{"uuid": "368126d6-8a37-4409-ae90-8aa4722d2ea7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:49.410327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] validate_networks() for [('7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:13:49.989985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:13:49.990443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:13:49.990922 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:13:49.991329 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:13:49.991740 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:13:50.002165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:50.002668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:50.003465 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:50.003903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:50.024155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:13:50.028982 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for user da9685af6f6f47c8a59fb93df9bd0ec1 and project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:13:50.089020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:13:50.091874 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='368126d6-8a37-4409-ae90-8aa4722d2ea7',volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:13:50.225540 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6a9a884c-2f99-4fe5-9aa4-0de712ceb39e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.989688 May 10 14:13:50.226177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 446/914] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:13:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:13:50.237392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-41efcc84-663e-4d17-83db-16df3af3e6c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:50.238111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-41efcc84-663e-4d17-83db-16df3af3e6c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:50.291221 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-41efcc84-663e-4d17-83db-16df3af3e6c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:50.298628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-41efcc84-663e-4d17-83db-16df3af3e6c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1095 microversion: 2.1 time: 0.065953 May 10 14:13:50.301488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 469/915] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:50 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:13:51.316238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:51.316756 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:51.322694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:51.323152 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:51.323929 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:51.324368 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:51.395501 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:51.404768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-217ab9cf-ad41-4be8-ac00-7c4616981aba tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1211 microversion: 2.1 time: 0.091752 May 10 14:13:51.405302 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 447/916] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:51 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:52.422553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:52.423170 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:52.431191 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:52.431653 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:52.432445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:52.433351 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:52.510562 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-43758a16-5b25-406c-bc4f-b4eb71ef9f2e req-66a5ed83-09a2-4252-848a-e8cb10e929e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446a4d1-9645-42b8-96b5-d61f47d6f420", "tag": "d54f85c7-9095-443b-84e0-81dde3eb2795"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:13:52.522424 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-43758a16-5b25-406c-bc4f-b4eb71ef9f2e req-66a5ed83-09a2-4252-848a-e8cb10e929e9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:52.523178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-43758a16-5b25-406c-bc4f-b4eb71ef9f2e req-66a5ed83-09a2-4252-848a-e8cb10e929e9 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:52.540516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-43758a16-5b25-406c-bc4f-b4eb71ef9f2e req-66a5ed83-09a2-4252-848a-e8cb10e929e9 service nova] Creating event network-changed:d54f85c7-9095-443b-84e0-81dde3eb2795 for instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 on hv-cinder-83588 May 10 14:13:52.546600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-43758a16-5b25-406c-bc4f-b4eb71ef9f2e req-66a5ed83-09a2-4252-848a-e8cb10e929e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039819 May 10 14:13:52.548339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 448/917] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:13:52.603553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:52.612796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-317a1b3e-ef22-4c7a-986c-afdce64bee5f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.195262 May 10 14:13:52.624070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 470/918] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:52 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:53.632507 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:53.633200 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:53.639833 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:53.640258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:53.641019 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:53.641449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:53.816629 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:53.824206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c90ead86-b529-47c9-a3e9-3b94843121e5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.196293 May 10 14:13:53.825387 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 449/919] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:53 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:54.841260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:54.841916 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:54.848293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:54.848746 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:54.849546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:54.849984 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:54.980124 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:54.988082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1e595b83-5599-480e-a29e-ed58eb78fc71 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.151138 May 10 14:13:54.988655 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 471/920] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:54 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:56.005536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:56.006142 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:56.013074 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:56.013534 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:56.014338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:56.014783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:56.150622 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:56.158053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-d181c6bf-1a10-4db1-b165-ec18bb763e62 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.156407 May 10 14:13:56.158651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 450/921] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:56 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:57.175349 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:57.175884 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:57.182123 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:57.182602 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:57.183365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:57.183800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:57.311553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:57.318842 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0e93ce06-0775-4108-a6d9-d9f69df21d54 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.147487 May 10 14:13:57.319398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 472/922] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:57 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:58.336318 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:58.336933 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:58.343835 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:58.344285 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:58.345051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:58.345487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:58.477246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:58.485181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-01f50128-ddfc-4e75-ab87-4ac2c72d7a6b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.152765 May 10 14:13:58.485737 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 451/923] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:58 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:13:59.502918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:13:59.503455 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:13:59.509786 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:59.510319 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:59.511087 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:13:59.511519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:13:59.643325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:13:59.650703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6dff9efe-3e20-4f29-b36c-20e862032c92 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.151979 May 10 14:13:59.651280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 473/924] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:13:59 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:14:00.667372 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:00.667980 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:00.674314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:00.674767 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:00.675527 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:00.675962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:00.806526 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:00.814910 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-740e92b5-ead3-4ad2-ba3a-6859c4e39ed2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.151402 May 10 14:14:00.815470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 452/925] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:00 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:01.832020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:01.832706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:01.838943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:01.839403 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:01.840158 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:01.840633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:01.978154 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:01.985706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ca16e617-694c-4561-8d0d-8cedb3be7f07 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.157578 May 10 14:14:01.986296 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 474/926] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:01 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:03.002336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:03.003033 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:03.009837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:03.010316 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:03.011088 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:03.011528 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:03.146039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:03.153867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-430233bf-b249-44a8-98cc-897635bed63a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.155628 May 10 14:14:03.154463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 453/927] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:02 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:04.175675 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:04.176491 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:04.187196 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:04.187660 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:04.188454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:04.189101 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:04.331557 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:04.339001 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-142f412c-45b4-47f5-b6d7-e90eadef5057 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.167428 May 10 14:14:04.339569 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 475/928] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:04 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:05.354985 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:05.355650 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:05.367828 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:05.368280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:05.369053 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:05.369491 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:05.499206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:05.506521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-30fea696-d46b-4a63-b046-d4f1eb4ea4fc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.155304 May 10 14:14:05.507077 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 454/929] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:05 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:06.523733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:06.524425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:06.531474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:06.532234 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:06.532765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:06.533237 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:06.665711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:06.674081 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4636c040-69d1-4a5b-ac4d-650179ba1800 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.154229 May 10 14:14:06.675303 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 476/930] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:06 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:07.691918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:07.692539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:07.698583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:07.699049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:07.699825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:07.700269 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:07.831062 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:07.838609 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8ca2246b-f30f-474b-9d81-bca2ba624c86 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.150714 May 10 14:14:07.839191 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 455/931] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:07 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:08.748318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-02958650-f311-47ce-a260-d5fc255da0f7 req-4e829967-1f88-4ef2-84cc-03180638642f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4446a4d1-9645-42b8-96b5-d61f47d6f420", "name": "network-vif-plugged", "status": "completed", "tag": "d54f85c7-9095-443b-84e0-81dde3eb2795"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:14:08.758416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-02958650-f311-47ce-a260-d5fc255da0f7 req-4e829967-1f88-4ef2-84cc-03180638642f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:08.758837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-02958650-f311-47ce-a260-d5fc255da0f7 req-4e829967-1f88-4ef2-84cc-03180638642f service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:08.770847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-02958650-f311-47ce-a260-d5fc255da0f7 req-4e829967-1f88-4ef2-84cc-03180638642f service nova] Creating event network-vif-plugged:d54f85c7-9095-443b-84e0-81dde3eb2795 for instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 on hv-cinder-83588 May 10 14:14:08.775856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-02958650-f311-47ce-a260-d5fc255da0f7 req-4e829967-1f88-4ef2-84cc-03180638642f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031806 May 10 14:14:08.776450 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 477/932] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:14:08.856280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:08.856928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:08.863967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:08.864417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:08.865185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:08.865620 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:09.027139 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:09.035361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-98195135-dc67-4d02-9f70-1a036826437d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.183081 May 10 14:14:09.035942 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 456/933] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:08 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:10.052649 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:10.053359 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:10.060003 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:10.061545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:10.062393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:10.062839 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:10.197254 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:10.205019 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-448d94b1-11a3-4e8a-8f0d-2a1343928bfc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1266 microversion: 2.1 time: 0.156661 May 10 14:14:10.205588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 478/934] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:10 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:11.221757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:11.222508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:11.228897 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:11.229353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:11.230127 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:11.230597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:11.382028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:11.390944 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e35b61f4-2692-452d-bfcd-26c23c3ccb95 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1452 microversion: 2.1 time: 0.173088 May 10 14:14:11.391516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 457/935] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:11 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:11.406926 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:14:11.407545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:14:11.413598 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:11.414056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:11.414922 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:11.415367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:11.545210 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:14:11.552571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a5878c1f-6445-42db-92a0-b0f1bd1550f9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1452 microversion: 2.1 time: 0.149513 May 10 14:14:11.553141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 479/936] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:14:11 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:14:13.268401 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-76190f2f-39e9-405f-b045-8356245ead7b req-38c9ffbe-05c2-4e4a-8ca8-cfb1d7f2c906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4446a4d1-9645-42b8-96b5-d61f47d6f420", "tag": "d54f85c7-9095-443b-84e0-81dde3eb2795"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:14:13.276580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-76190f2f-39e9-405f-b045-8356245ead7b req-38c9ffbe-05c2-4e4a-8ca8-cfb1d7f2c906 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:14:13.277025 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-76190f2f-39e9-405f-b045-8356245ead7b req-38c9ffbe-05c2-4e4a-8ca8-cfb1d7f2c906 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:14:13.288289 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-76190f2f-39e9-405f-b045-8356245ead7b req-38c9ffbe-05c2-4e4a-8ca8-cfb1d7f2c906 service nova] Creating event network-changed:d54f85c7-9095-443b-84e0-81dde3eb2795 for instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 on hv-cinder-83588 May 10 14:14:13.293441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-76190f2f-39e9-405f-b045-8356245ead7b req-38c9ffbe-05c2-4e4a-8ca8-cfb1d7f2c906 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028716 May 10 14:14:13.294248 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 458/937] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:15:00.201110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:00.201628 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:00.207445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:00.207892 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:00.208659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:00.209096 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:00.231433 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0cbac4e7-5ef9-4672-b8e6-6d9410917cbc tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/ips" status: 200 len: 152 microversion: 2.20 time: 0.219501 May 10 14:15:00.232664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 480/938] 10.222.0.32 () {60 vars in 1288 bytes} [Tue May 10 14:15:00 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/ips => generated 152 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 14:15:02.048519 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:02.049146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:02.059065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:02.060392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:02.061809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:02.062656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:02.086930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lazy-loading 'flavor' on Instance uuid e3ba3b5d-421b-4d65-b08e-59368f66a76b {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:15:02.348353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0c09fa8a-f4bd-47e6-be20-1313813a206f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/action" status: 202 len: 0 microversion: 2.20 time: 0.304661 May 10 14:15:02.349039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 459/939] 10.222.0.32 () {62 vars in 1318 bytes} [Tue May 10 14:15:02 2022] POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:15:02.357595 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:02.358224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:02.364775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:02.365304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:02.366024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:02.366532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:02.495527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:02.504481 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:02.505987 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:02.507169 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fbdc8eb1-7356-4a59-8c6b-0a141be9fe0b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.154049 May 10 14:15:02.507725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 481/940] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:02 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:03.527087 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:03.527796 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:03.534870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:03.535336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:03.536113 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:03.536558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:03.664912 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:03.673722 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:03.675270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:03.676435 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ce1aa61e-9c11-4f1c-a9e3-7b6630708561 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.154582 May 10 14:15:03.676991 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 460/941] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:03 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:04.695148 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:04.695762 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:04.702808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:04.703265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:04.704035 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:04.704469 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:05.014222 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:05.021907 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:05.023453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:05.024609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-935cf69a-5a44-4d2f-93d5-9fd2bec6d36e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.333394 May 10 14:15:05.025163 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 482/942] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:04 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:06.042893 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:06.043504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:06.049856 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:06.050343 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:06.051116 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:06.051554 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:06.181028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:06.189492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:06.191028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:06.192188 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8f64ab0a-65fb-4060-8054-167e19ea65af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.153201 May 10 14:15:06.192742 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 461/943] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:06 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:07.210013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:07.210670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:07.218048 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:07.218524 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:07.219301 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:07.219734 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:07.350546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:07.358288 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:07.359829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:07.360978 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-7d19763e-d968-4d59-a852-5a2f4d735fda tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.154932 May 10 14:15:07.361518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 483/944] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:07 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:08.380028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:08.380636 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:08.386747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:08.387195 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:08.388021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:08.388491 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:08.518512 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:08.526167 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:08.527689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:08.529520 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dba3963a-98e3-495b-a97d-ead4066f71e1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.152743 May 10 14:15:08.530063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 462/945] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:08 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:09.548541 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:09.549142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:09.555574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:09.556030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:09.556806 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:09.557248 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:09.686111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:09.693909 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:09.695452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:09.696597 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fd3cba9b-e4ab-4ea5-bc8e-d9efccefbd53 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.153063 May 10 14:15:09.697143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 484/946] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:09 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:09.751392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:15:09.751590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:15:10.714990 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:10.715600 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:10.722072 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:10.722555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:10.723328 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:10.723757 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:10.852409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:10.861277 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:10.862829 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:10.864007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-0cc8e3b7-661d-42ec-bf36-91b45bbec2af tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.152991 May 10 14:15:10.864565 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 463/947] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:10 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:11.882796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:11.883418 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:11.889431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:11.889877 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:11.890682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:11.891121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:12.016689 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:12.024488 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:12.026006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:12.027198 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-90d19ee6-1675-4b6a-9bf3-bd5b3c717f3d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.148547 May 10 14:15:12.027747 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 485/948] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:11 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:13.045994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:13.046694 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:13.053063 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:13.053511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:13.054293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:13.054732 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:13.186509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:13.194386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:13.195891 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:13.197046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-4935aab9-f6ca-4ffb-81a5-b75078e1b224 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.155045 May 10 14:15:13.197595 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 464/949] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:13 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:14.215841 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:14.216594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:14.222868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:14.223319 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:14.224084 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:14.224519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:14.348880 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:14.357147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:14.358664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:14.359803 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-40055aeb-6089-4382-b314-69cf25302840 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1744 microversion: 2.20 time: 0.147943 May 10 14:15:14.360354 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 486/950] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:14 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:15.379404 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:15.380021 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:15.386579 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:15.387039 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:15.387892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:15.388337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:15.518024 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:15.525992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:15.527535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:15.529187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-563e569d-4763-4021-807d-358f8d41fe00 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1744 microversion: 2.20 time: 0.153762 May 10 14:15:15.529831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 465/951] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:15 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:16.548328 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:16.548939 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:16.556006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:16.556505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:16.557398 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:16.557886 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:16.693967 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:16.702890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:16.704443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:16.705639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-fa580b78-3ce2-43a4-8dfa-3f854aa97fa2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1744 microversion: 2.20 time: 0.162331 May 10 14:15:16.706217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 487/952] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:16 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:17.104547 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-403de0df-f628-4218-b5df-e33f9dfe8f5d req-9d5efa2e-6c94-4693-82ea-cbc07ce75b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "name": "network-vif-plugged", "status": "completed", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:17.113898 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-403de0df-f628-4218-b5df-e33f9dfe8f5d req-9d5efa2e-6c94-4693-82ea-cbc07ce75b68 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:17.114386 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-403de0df-f628-4218-b5df-e33f9dfe8f5d req-9d5efa2e-6c94-4693-82ea-cbc07ce75b68 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:17.127793 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-403de0df-f628-4218-b5df-e33f9dfe8f5d req-9d5efa2e-6c94-4693-82ea-cbc07ce75b68 service nova] Creating event network-vif-plugged:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:15:17.132836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-403de0df-f628-4218-b5df-e33f9dfe8f5d req-9d5efa2e-6c94-4693-82ea-cbc07ce75b68 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032045 May 10 14:15:17.133442 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 466/953] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:15:17.724664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:17.725289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:17.731763 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:17.732218 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:17.733853 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:17.734449 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:17.863438 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:17.871452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:17.872972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:17.874592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cad2cc55-6eb4-4fbb-a43d-4b511e2300d4 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1744 microversion: 2.20 time: 0.153946 May 10 14:15:17.875134 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 488/954] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:17 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:18.893662 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:18.894987 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:18.902480 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:18.903192 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:18.904185 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:18.905515 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:19.060400 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:19.069613 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:19.071484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:19.072742 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a150a283-b7d1-4b59-a402-b6837ecbe3d7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.184556 May 10 14:15:19.073420 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 467/955] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:18 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:20.092725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:20.093332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:20.100457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:20.100904 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:20.101691 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:20.102130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:20.512014 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:20.520588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:20.522122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:20.523314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cd8831b2-d551-4847-a1fc-0de0cb0930f3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.434600 May 10 14:15:20.524243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 489/956] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:20 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:21.542314 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:21.543364 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:21.553319 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:21.553783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:21.554606 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:21.555054 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:21.708090 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:21.721180 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:21.722950 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:21.724136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-7b1dbc12-657d-47d1-a4f0-4e3246b2895e tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.187147 May 10 14:15:21.724889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 468/957] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:21 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 14:15:22.742679 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:22.743385 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:22.753816 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:22.754309 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:22.755098 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:22.755543 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:22.898391 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:22.909605 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:22.911282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:22.912445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e997d01f-94d2-413b-a580-3ac669ae1c3f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.173756 May 10 14:15:22.913000 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 490/958] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:22 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:23.931884 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:23.932534 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:23.940866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:23.940866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:23.940866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:23.941244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:24.075365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:24.084092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:24.085582 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:24.086792 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f08a49af-8cea-45e7-8f61-1d448e60d649 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.159634 May 10 14:15:24.100665 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 469/959] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:23 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:25.105584 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:25.106473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:25.113350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:25.113805 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:25.114648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:25.115083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:25.277082 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:25.286570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:25.289547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:25.291168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c671fd4f-a014-4337-bcff-494d0ef483ee tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.190236 May 10 14:15:25.291726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 491/960] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:25 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:26.311681 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:26.312331 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:26.319809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:26.320357 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:26.321233 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:26.321747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:26.486879 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:26.496840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:26.497593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:26.499131 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-42def687-2719-45a3-a890-5e0f451e2bdd tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.193108 May 10 14:15:26.511846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 470/961] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:26 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:27.519890 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:27.520445 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:27.526828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:27.527285 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:27.528061 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:27.528505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:27.658638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:27.666646 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:27.668168 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:27.669326 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8ccff3e2-25d3-47ee-a956-dd4430216c4c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1739 microversion: 2.20 time: 0.153544 May 10 14:15:27.670519 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 492/962] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:27 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:28.689948 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:28.690521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:28.696966 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:28.697426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:28.698219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:28.698672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:28.831214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:28.839274 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:28.840782 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:28.842004 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-530089a0-6e65-4a0b-b251-f81f49d2561b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1721 microversion: 2.20 time: 0.157323 May 10 14:15:28.842586 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 471/963] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:28 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:29.861097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:29.861716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:29.868114 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:29.868567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:29.869329 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:29.869765 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:30.000294 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:30.008230 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:30.009776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:30.010990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3feccb37-d548-4270-bd0c-d48abdbde973 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1721 microversion: 2.20 time: 0.154604 May 10 14:15:30.011538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 493/964] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:29 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:31.028744 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:31.029999 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:31.036409 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.036862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.037672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.038114 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.169138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:31.171863 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-acc9ef87-0230-4b96-bbfe-03ba81980285 req-adac7c1a-495a-46f8-bfc5-aef5df8819a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "name": "network-vif-unplugged", "status": "completed", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:31.178148 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:31.179743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:31.181060 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f3029a99-55cc-443d-a4f9-1e1f08b60ae9 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1664 microversion: 2.20 time: 0.156127 May 10 14:15:31.181821 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 472/965] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:31 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:31.182501 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-acc9ef87-0230-4b96-bbfe-03ba81980285 req-adac7c1a-495a-46f8-bfc5-aef5df8819a6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.183024 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-acc9ef87-0230-4b96-bbfe-03ba81980285 req-adac7c1a-495a-46f8-bfc5-aef5df8819a6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.195783 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.compute.server_external_events [req-acc9ef87-0230-4b96-bbfe-03ba81980285 req-adac7c1a-495a-46f8-bfc5-aef5df8819a6 service nova] Unable to find a host for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b. Dropping event network-vif-unplugged {{(pid=117186) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 14:15:31.196683 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-acc9ef87-0230-4b96-bbfe-03ba81980285 req-adac7c1a-495a-46f8-bfc5-aef5df8819a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031316 May 10 14:15:31.197272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 494/966] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 10 14:15:31.200859 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76dbffb8-07d9-44f9-96b4-209dfe1e63b0"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:31.202539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:31.208740 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.209226 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.210903 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.211105 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.483558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-33b8396e-5cc3-4691-95ac-0da401c79c04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286522 May 10 14:15:31.484171 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 473/967] 10.222.0.32 () {62 vars in 1363 bytes} [Tue May 10 14:15:31 2022] POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 14:15:31.598386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:31.598879 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:31.604906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.605382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.606143 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.606600 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.846922 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f7425401-98fd-4490-93a5-dcc44b6ff40c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments/76dbffb8-07d9-44f9-96b4-209dfe1e63b0" status: 202 len: 0 microversion: 2.20 time: 0.252528 May 10 14:15:31.847515 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 495/968] 10.222.0.32 () {60 vars in 1456 bytes} [Tue May 10 14:15:31 2022] DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments/76dbffb8-07d9-44f9-96b4-209dfe1e63b0 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:15:31.903745 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:31.904333 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:31.910589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.911038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:31.911804 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:31.912264 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:32.009715 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a5b97f0e-91ba-4723-b79a-ee45d9255a46 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/action" status: 202 len: 0 microversion: 2.20 time: 0.109923 May 10 14:15:32.010358 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 474/969] 10.222.0.32 () {62 vars in 1318 bytes} [Tue May 10 14:15:31 2022] POST /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 14:15:32.018716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:32.019334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:32.026556 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:32.027023 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:32.027990 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:32.028431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:32.165721 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:32.175667 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:32.177364 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:32.178553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1d36c52a-6af1-44d8-b382-94b1b70a0621 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1672 microversion: 2.20 time: 0.163951 May 10 14:15:32.179141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 496/970] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:32 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:33.197407 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:33.198027 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:33.205052 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:33.205535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:33.206394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:33.206840 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:33.369395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:33.378440 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:33.379979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:33.381137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-887c9077-dc0f-407a-ba0f-427b54b5623c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.188183 May 10 14:15:33.381695 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 475/971] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:33 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:34.408788 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:34.410573 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:34.427401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:34.430794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:34.433489 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:34.435046 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:34.601682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:34.611417 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:34.613314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:34.614754 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-900d9663-eac9-4013-a723-b6dbd431cf65 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.216363 May 10 14:15:34.615397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 497/972] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:34 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:35.645229 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:35.646005 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:35.652640 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:35.653096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:35.653892 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:35.656299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:35.813706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:35.822452 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:35.824059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:35.825270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-578a05fc-c7a0-4abb-abbc-c740ca573026 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.185718 May 10 14:15:35.826755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 476/973] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:35 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:36.845352 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:36.845996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:36.858456 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:36.858757 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:36.859552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:36.859991 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:37.007548 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:37.016122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:37.017633 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:37.018830 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a23f5332-8aac-48da-92fe-0978614fd391 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.177921 May 10 14:15:37.019386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 498/974] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:36 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:38.037336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:38.038258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:38.044988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:38.045463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:38.046301 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:38.046749 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:38.193982 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:38.204217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:38.205748 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:38.206970 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-82c6a573-42bc-4b74-8141-9ccd7b6bb4a2 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.173879 May 10 14:15:38.207544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 477/975] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:38 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:39.226384 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:39.227070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:39.234066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:39.234510 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:39.235494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:39.235941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:39.384820 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:39.396767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:39.398325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:39.399566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0b407b8d-d84f-49a6-9e8b-f5dc1b67415b tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.177285 May 10 14:15:39.400133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 499/976] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:39 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:40.419583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:40.421147 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:40.428632 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:40.429130 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:40.429994 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:40.430512 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:40.596395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:40.605043 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:40.606755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:40.608649 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3cce0aa8-f827-483d-9b2b-177bcfeb82a1 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.193505 May 10 14:15:40.609470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 478/977] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:40 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:41.627552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:41.628609 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:41.635436 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.636135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.637052 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:41.637496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:41.783808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:41.797708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:41.797708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:41.797708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-467e8a7d-09a1-4207-82e3-1ac4c962ba0c tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.170367 May 10 14:15:41.798074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 500/978] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:41 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:42.811815 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:42.812629 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:42.819093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:42.819547 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:42.820316 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:42.820755 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:42.961571 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:42.969576 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:42.971141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:42.972391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b1ae4afb-d327-483e-bf0a-fef00b10de26 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.164917 May 10 14:15:42.972921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 479/979] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:42 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:43.992362 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:43.992980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:44.000408 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:44.000858 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:44.001648 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:44.002102 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:44.132718 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:44.141091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:44.142638 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:44.143808 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e2b9e258-cc9f-43ad-b1b1-bb616bb09963 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.155449 May 10 14:15:44.144363 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 501/980] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:43 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:45.162495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:45.163031 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:45.169436 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:45.169890 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:45.170795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:45.171263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:45.297054 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:45.304789 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:45.306348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:45.307493 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cc81e0d0-8469-4d44-af69-2ac6560dd4eb tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.149053 May 10 14:15:45.308045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 480/981] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:45 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:46.328028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:46.328733 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:46.335623 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:46.336127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:46.336889 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:46.337326 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:46.471797 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:46.480771 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:46.482505 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:46.485258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-08e417af-7dca-453e-8ef8-a0cf7c8d5b9f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.161817 May 10 14:15:46.485976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 502/982] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:46 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:47.503363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:47.503973 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:47.510497 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:47.510945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:47.511707 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:47.512144 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:47.646361 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:47.655286 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:47.657363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:47.658615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1d3b07aa-56f3-4b7d-8521-7b47d11fb81f tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.159384 May 10 14:15:47.659221 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 481/983] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:47 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:48.677672 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:48.678376 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:48.685551 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:48.686610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:48.688671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:48.689114 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:48.825407 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:48.833782 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:48.835341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:48.836520 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-11e59fce-77c9-41f5-9d0c-eb8390eb8817 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.163099 May 10 14:15:48.837077 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 503/984] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:48 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:49.314028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-e1cd76cb-152d-4db4-867c-34de3153a388 req-c0b03848-d9e6-49f1-8a90-a7041562d2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "name": "network-vif-plugged", "status": "completed", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:15:49.323022 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e1cd76cb-152d-4db4-867c-34de3153a388 req-c0b03848-d9e6-49f1-8a90-a7041562d2fd service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:49.323635 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-e1cd76cb-152d-4db4-867c-34de3153a388 req-c0b03848-d9e6-49f1-8a90-a7041562d2fd service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:49.336638 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-e1cd76cb-152d-4db4-867c-34de3153a388 req-c0b03848-d9e6-49f1-8a90-a7041562d2fd service nova] Creating event network-vif-plugged:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:15:49.341631 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-e1cd76cb-152d-4db4-867c-34de3153a388 req-c0b03848-d9e6-49f1-8a90-a7041562d2fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 May 10 14:15:49.342931 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 482/985] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:15:49.856939 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:49.857680 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:49.865160 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:49.865618 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:49.866449 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:49.866889 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:50.003200 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:50.011037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:50.012582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:50.013738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b19c525a-b885-4fe0-8d75-30fee3b7bdf3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.160816 May 10 14:15:50.014972 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 504/986] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:49 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:51.034532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:51.035267 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:51.041590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:51.042042 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:51.042843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:51.043284 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:51.184081 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:51.194471 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:51.196240 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:51.197428 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-18825ea4-a436-47f8-ae3e-244fede54fe3 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1730 microversion: 2.20 time: 0.168228 May 10 14:15:51.197992 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 483/987] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:51 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:15:52.215942 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:15:52.216555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:15:52.224264 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:52.224723 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:52.225514 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:15:52.225978 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:15:52.385864 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:52.396070 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:52.397881 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:15:52.399280 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-445a851d-b170-4525-835b-b197eb1bb5c7 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1717 microversion: 2.20 time: 0.187384 May 10 14:15:52.399956 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 505/988] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:15:52 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1717 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:28.037444 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:28.038073 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:28.044177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:28.044637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:28.045426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:28.045869 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:28.076003 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:16:28.164544 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b75d9639-e191-4293-83a5-0e253b439e23 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 204 len: 0 microversion: 2.1 time: 0.130618 May 10 14:16:28.165342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 484/989] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:16:28 2022] DELETE /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:16:28.174686 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:28.175321 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:28.181594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:28.182039 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:28.182846 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:28.183276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:28.318496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:28.325994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-15ec67d1-cb96-4211-a3b2-1f1aadd2d88f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1576 microversion: 2.1 time: 0.155937 May 10 14:16:28.326652 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 506/990] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:28 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:16:29.345456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:29.346189 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:29.353514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:29.353988 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:29.354785 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:29.355219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:29.495770 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:29.503927 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6bebe86c-e9da-4c04-9ef8-28ac8bcbac0d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1576 microversion: 2.1 time: 0.163752 May 10 14:16:29.504507 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 485/991] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:29 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:30.521861 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:30.522514 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:30.529216 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:30.529683 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:30.530550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:30.531001 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:30.605044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:30.613774 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-edd0dfd3-dd5f-494b-85a9-d237f8ad87db tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 200 len: 1509 microversion: 2.1 time: 0.095819 May 10 14:16:30.614393 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 507/992] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:30 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 1509 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:16:30.842539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-c9ecb99a-f5ad-48c9-b1ce-1320110e45ea req-550e5ac0-f580-4b1f-9636-24f511305851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4446a4d1-9645-42b8-96b5-d61f47d6f420", "name": "network-vif-deleted", "tag": "d54f85c7-9095-443b-84e0-81dde3eb2795"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:30.859697 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c9ecb99a-f5ad-48c9-b1ce-1320110e45ea req-550e5ac0-f580-4b1f-9636-24f511305851 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:30.861238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c9ecb99a-f5ad-48c9-b1ce-1320110e45ea req-550e5ac0-f580-4b1f-9636-24f511305851 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:30.884539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-c9ecb99a-f5ad-48c9-b1ce-1320110e45ea req-550e5ac0-f580-4b1f-9636-24f511305851 service nova] Creating event network-vif-deleted:d54f85c7-9095-443b-84e0-81dde3eb2795 for instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 on hv-cinder-83588 May 10 14:16:30.895067 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-c9ecb99a-f5ad-48c9-b1ce-1320110e45ea req-550e5ac0-f580-4b1f-9636-24f511305851 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059469 May 10 14:16:30.896418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 486/993] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:31.631338 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:31.632121 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:31.638692 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:31.639166 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:31.639954 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:31.640485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:31.659050 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] HTTP exception thrown: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Request method failure captured: May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 HTTP/1.1 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienL2NnrYT5F7KUoDFS1gtWw8idP-pytSjh3HooGNi8y2-bRe_KUDm94O9hnxzyn99mZLb4Qc2qqRnRBCv5VJV45_LasehH7RD2ZNe_PsaJJTAXoiROVT2TGpN5W23wwdi3ZYeIFO4avCbYPTyji6GqbETtxVt-U3ufAvIIuqKvybic4 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 6350c410027a478988e364b17696da95 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:16:31.663020 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/6350c410027a478988e364b17696da95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_6350c410027a478988e364b17696da95", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-TestVolumeBootPattern-993200433 May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 6350c410027a478988e364b17696da95 May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-TestVolumeBootPattern-993200433-project May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: da9685af6f6f47c8a59fb93df9bd0ec1 May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-TestVolumeBootPattern-993200433-project May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:16:31.664681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '4446a4d1-9645-42b8-96b5-d61f47d6f420'} May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:31.665538 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:16:31.666941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:31.669368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Returning 404 to user: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:31.669368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-db7cf2d0-9bd0-406b-987b-2cae695fb2c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 404 len: 111 microversion: 2.1 time: 0.034825 May 10 14:16:31.669368 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 508/994] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:31 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:16:31.767359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1102316895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102038041", "security_groups": [{"name": "tempest-secgroup-smoke-153034832"}], "block_device_mapping_v2": [{"uuid": "368126d6-8a37-4409-ae90-8aa4722d2ea7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:31.889644 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] validate_networks() for [('7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:16:32.290144 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:16:32.290593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:16:32.291067 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:16:32.291470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:16:32.291883 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:16:32.301417 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:32.301866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:32.302701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:32.303134 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:32.320220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:16:32.324177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for user da9685af6f6f47c8a59fb93df9bd0ec1 and project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:16:32.386918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:16:32.389177 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='368126d6-8a37-4409-ae90-8aa4722d2ea7',volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:16:32.523542 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-41c924f7-979f-47a8-b5a2-b449163c452b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760713 May 10 14:16:32.524189 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 487/995] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:16:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:16:32.534770 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3881d687-d40c-424f-90a3-9402b643c429 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:32.535396 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3881d687-d40c-424f-90a3-9402b643c429 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:32.593870 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3881d687-d40c-424f-90a3-9402b643c429 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:32.602129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3881d687-d40c-424f-90a3-9402b643c429 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1095 microversion: 2.1 time: 0.071740 May 10 14:16:32.602744 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 509/996] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:32 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:33.620170 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:33.621080 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:33.631255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:33.631825 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:33.632643 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:33.633172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:33.710055 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:33.718705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-cdf540c6-bf16-431a-b453-f073b2a2637b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1211 microversion: 2.1 time: 0.102177 May 10 14:16:33.719827 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 488/997] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:33 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:34.736671 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:34.737330 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:34.744988 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:34.745447 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:34.746267 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:34.746711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:34.899233 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:34.907290 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-46480ad6-bac1-45f8-8c86-0b0084b8197c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.174953 May 10 14:16:34.908066 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 510/998] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:34 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:35.182783 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-c7eff355-b1b9-47da-be42-30ea690b39a1 req-c005e938-a9dd-4289-a7fa-17cccffc13e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d89cd9-9357-40e8-912a-aacd29e0250f", "tag": "f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:35.220365 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c7eff355-b1b9-47da-be42-30ea690b39a1 req-c005e938-a9dd-4289-a7fa-17cccffc13e6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:35.221138 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c7eff355-b1b9-47da-be42-30ea690b39a1 req-c005e938-a9dd-4289-a7fa-17cccffc13e6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:35.234086 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-c7eff355-b1b9-47da-be42-30ea690b39a1 req-c005e938-a9dd-4289-a7fa-17cccffc13e6 service nova] Creating event network-changed:f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd for instance 21d89cd9-9357-40e8-912a-aacd29e0250f on hv-cinder-83588 May 10 14:16:35.240945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-c7eff355-b1b9-47da-be42-30ea690b39a1 req-c005e938-a9dd-4289-a7fa-17cccffc13e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065170 May 10 14:16:35.241689 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 489/999] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:35.925424 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:35.926083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:35.932528 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:35.932985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:35.933766 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:35.934238 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:36.062567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:36.070753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cacb953b-809a-4272-8c3a-81c38f2fd5c9 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.149892 May 10 14:16:36.071328 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 511/1000] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:35 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:37.089308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:37.089928 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:37.096995 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:37.097449 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:37.098321 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:37.098720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:37.237566 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:37.245295 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-21b16554-487d-478f-8c70-152a0eb8a6c4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.160748 May 10 14:16:37.245872 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 490/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:37 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:38.263097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:38.263706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:38.270832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:38.271281 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:38.272052 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:38.272485 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:38.413703 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:38.421275 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0860ed1c-a17f-407f-a5fb-e4946f7f5a55 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.162066 May 10 14:16:38.421847 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 512/1002] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:38 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:39.441621 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:39.442275 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:39.448437 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:39.448893 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:39.449666 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:39.450103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:39.630867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:39.638441 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6e699340-f237-476f-b262-017a7b5c0c8c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.203392 May 10 14:16:39.639070 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 491/1003] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:39 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:40.656574 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:40.657837 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:40.664346 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:40.664796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:40.665572 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:40.666011 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:40.802005 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:40.809506 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-1f9b31fc-0678-44af-8c63-18e32d057ea1 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.156991 May 10 14:16:40.810083 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 513/1004] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:40 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:41.827373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:41.828182 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:41.835968 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:41.836429 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:41.837224 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:41.837675 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:41.981363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:41.990818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bd457ba8-f952-4bb7-ab66-94f714625160 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.167146 May 10 14:16:41.991624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 492/1005] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:41 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:43.009080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:43.009961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:43.017175 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:43.017650 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:43.018794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:43.019242 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:43.166318 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:43.175137 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-65dc18ea-7e4e-4e78-ad0c-31f835c1ef1f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.170112 May 10 14:16:43.175711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 514/1006] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:43 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:44.192665 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:44.193244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:44.200120 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:44.200355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:44.201035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:44.201473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:44.343016 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:44.352398 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-211581f5-6441-409d-b709-5a957242cea6 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.163833 May 10 14:16:44.352999 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 493/1007] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:44 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:45.369883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:45.369883 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:45.377815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:45.378304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:45.379108 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:45.379553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:45.535686 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-b4e06e71-10db-44fd-82e8-f40ab5da80cf req-f2f1bf71-e7da-434d-8783-87dc83db6ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d89cd9-9357-40e8-912a-aacd29e0250f", "name": "network-vif-plugged", "status": "completed", "tag": "f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:45.545704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-b4e06e71-10db-44fd-82e8-f40ab5da80cf req-f2f1bf71-e7da-434d-8783-87dc83db6ad8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:45.547234 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-b4e06e71-10db-44fd-82e8-f40ab5da80cf req-f2f1bf71-e7da-434d-8783-87dc83db6ad8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:45.561234 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-b4e06e71-10db-44fd-82e8-f40ab5da80cf req-f2f1bf71-e7da-434d-8783-87dc83db6ad8 service nova] Creating event network-vif-plugged:f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd for instance 21d89cd9-9357-40e8-912a-aacd29e0250f on hv-cinder-83588 May 10 14:16:45.568401 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-b4e06e71-10db-44fd-82e8-f40ab5da80cf req-f2f1bf71-e7da-434d-8783-87dc83db6ad8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037835 May 10 14:16:45.569446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 494/1008] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:16:45.597522 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:45.606157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ff7ffa03-7e91-4519-bd24-ecf74d635a0a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.240905 May 10 14:16:45.611913 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 515/1009] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:45 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:45.896674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:16:45.896975 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:16:46.626464 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:46.627557 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:46.634558 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:46.635044 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:46.635836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:46.636279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:46.800795 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:46.810590 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-1ef8775d-c33c-4b4d-952d-b79d11143300 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1266 microversion: 2.1 time: 0.188708 May 10 14:16:46.811810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 495/1010] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:46 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:47.829740 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:47.830743 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:47.839621 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.840276 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:47.841372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.842056 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:47.970866 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:47.972166 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:47.979263 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.979727 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:47.980532 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:47.980979 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:47.994295 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:48.004075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-182ebdea-1629-445c-a9c8-4dbd174bb474 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1451 microversion: 2.1 time: 0.178387 May 10 14:16:48.004794 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 516/1011] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:47 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:48.014871 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5de71155-4797-4cc5-a57c-48ae6aaa8a04 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048309 May 10 14:16:48.015447 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 496/1012] 10.222.0.32 () {60 vars in 1342 bytes} [Tue May 10 14:16:47 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:16:48.021634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:48.022419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:48.028355 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.028813 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.029595 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.030044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.078357 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:48.078895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:48.085967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.086371 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.087160 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.087593 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.116301 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:16:48.177706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:48.186153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f961ded8-e668-4dea-914d-d3405ba7febb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1451 microversion: 2.1 time: 0.168905 May 10 14:16:48.186773 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 517/1013] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:16:48 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:16:48.217181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-88566935-ad39-42a1-b1a7-6645bb07a363 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 204 len: 0 microversion: 2.20 time: 0.139489 May 10 14:16:48.217181 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 497/1014] 10.222.0.32 () {60 vars in 1279 bytes} [Tue May 10 14:16:48 2022] DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 14:16:48.231430 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:48.232044 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:48.239141 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.239594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.240373 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:48.240810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:48.396090 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:48.404223 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:48.405752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:48.406968 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-e47d23fb-daee-4133-9dd5-21bbbb7b7388 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.185973 May 10 14:16:48.408057 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 518/1015] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:48 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:49.428178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:49.429539 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:49.436189 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:49.436654 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:49.437450 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:49.437895 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:49.669615 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:49.679812 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:49.681482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:49.682772 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b46e53ba-261a-4bc5-b417-d3514dd875e0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.260229 May 10 14:16:49.683341 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 498/1016] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:49 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:50.402559 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-7344b2c8-1d4a-4c79-b139-b2ac5975cade req-80a70dcc-9924-4ca3-9c83-b021cbd376d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d89cd9-9357-40e8-912a-aacd29e0250f", "tag": "f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:50.416224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-7344b2c8-1d4a-4c79-b139-b2ac5975cade req-80a70dcc-9924-4ca3-9c83-b021cbd376d8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.417099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-7344b2c8-1d4a-4c79-b139-b2ac5975cade req-80a70dcc-9924-4ca3-9c83-b021cbd376d8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.432367 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-7344b2c8-1d4a-4c79-b139-b2ac5975cade req-80a70dcc-9924-4ca3-9c83-b021cbd376d8 service nova] Creating event network-changed:f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd for instance 21d89cd9-9357-40e8-912a-aacd29e0250f on hv-cinder-83588 May 10 14:16:50.437586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-7344b2c8-1d4a-4c79-b139-b2ac5975cade req-80a70dcc-9924-4ca3-9c83-b021cbd376d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041643 May 10 14:16:50.438381 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 519/1017] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:50.701161 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:50.701720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:50.708810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.709261 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:50.710046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:50.711214 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:51.005524 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:51.018780 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:51.020408 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:51.021818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-9b94ddd4-ecfd-46ec-8809-551ae447aa68 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1723 microversion: 2.20 time: 0.324735 May 10 14:16:51.033569 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 499/1018] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:50 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:52.043478 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:52.045135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:52.054021 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.055075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.056206 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.056805 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.097261 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.099224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.099224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lazy-loading 'fault' on Instance uuid e3ba3b5d-421b-4d65-b08e-59368f66a76b {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:16:52.161785 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:52.177591 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:52.179631 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3069e17bfc5d4e34ab7f5c61f48d9f11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c251b9c401c6455da95be74c9119b8d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:16:52.181080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-790ed6e7-fda8-4146-a0cb-623895a7f2d0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 200 len: 1371 microversion: 2.20 time: 0.143743 May 10 14:16:52.182055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 520/1019] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:52 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 14:16:52.463703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-8131f05d-412c-4ce7-9b82-f534e95d7647 req-51b4cd15-7de7-47c4-89aa-00f49b2ab3a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ba3b5d-421b-4d65-b08e-59368f66a76b", "name": "network-vif-deleted", "tag": "4a51355d-8fd3-46f7-b6a5-26ec89cb16c2"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:16:52.473773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-8131f05d-412c-4ce7-9b82-f534e95d7647 req-51b4cd15-7de7-47c4-89aa-00f49b2ab3a8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:52.474239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-8131f05d-412c-4ce7-9b82-f534e95d7647 req-51b4cd15-7de7-47c4-89aa-00f49b2ab3a8 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:52.490419 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-8131f05d-412c-4ce7-9b82-f534e95d7647 req-51b4cd15-7de7-47c4-89aa-00f49b2ab3a8 service nova] Creating event network-vif-deleted:4a51355d-8fd3-46f7-b6a5-26ec89cb16c2 for instance e3ba3b5d-421b-4d65-b08e-59368f66a76b on hv-cinder-83588 May 10 14:16:52.501014 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-8131f05d-412c-4ce7-9b82-f534e95d7647 req-51b4cd15-7de7-47c4-89aa-00f49b2ab3a8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040679 May 10 14:16:52.502074 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 500/1020] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:16:53.201208 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:53.201825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:53.209453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:53.209902 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:53.210711 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:53.211146 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:53.225518 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b HTTP/1.1 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:16:53.229053 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:53.232722 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'e3ba3b5d-421b-4d65-b08e-59368f66a76b'} May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:53.234599 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:53.237825 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:53.240231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:53.240231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-aa5caaad-da5e-4b35-996c-8ed073a95a0d tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 404 len: 111 microversion: 2.20 time: 0.031550 May 10 14:16:53.240231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 521/1021] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:53 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:16:53.240668 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-759ad6dd-92c0-417d-8ad2-fa3d1609ab60 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '.version_select at 0x7efd56134dc0>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:53.263098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-759ad6dd-92c0-417d-8ad2-fa3d1609ab60 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860653310" status: 204 len: 0 microversion: 2.20 time: 0.028899 May 10 14:16:53.263671 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 501/1022] 10.222.0.32 () {60 vars in 1258 bytes} [Tue May 10 14:16:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860653310 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 14:16:55.051132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:55.051727 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:55.059097 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:55.059582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:55.060470 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:55.060913 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:55.076548 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b HTTP/1.1 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:16:55.078147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.082130 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': 'e3ba3b5d-421b-4d65-b08e-59368f66a76b'} May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:55.083086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.084525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:55.086047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:55.086047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bc3ffd13-5c87-469b-8c20-b02b6754c0ec tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 404 len: 111 microversion: 2.20 time: 0.033308 May 10 14:16:55.086047 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 522/1023] 10.222.0.32 () {60 vars in 1279 bytes} [Tue May 10 14:16:55 2022] DELETE /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:16:55.091103 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:55.091842 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: e3ba3b5d-421b-4d65-b08e-59368f66a76b] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:55.099611 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:55.100068 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:55.100850 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:55.101293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:55.116776 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b HTTP/1.1 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:16:55.118467 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.120346 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': 'e3ba3b5d-421b-4d65-b08e-59368f66a76b'} May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:55.121521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. May 10 14:16:55.122836 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:55.124246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance e3ba3b5d-421b-4d65-b08e-59368f66a76b could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:55.124246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-36dc44d8-b966-414f-88a1-98357f0e78b0 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b" status: 404 len: 111 microversion: 2.20 time: 0.034176 May 10 14:16:55.124246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 502/1024] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:55 2022] GET /compute/v2.1/servers/e3ba3b5d-421b-4d65-b08e-59368f66a76b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:16:56.283695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:56.284289 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:56.291464 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.291918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.292696 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.293136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.307217 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d HTTP/1.1 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:16:56.308784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.310547 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '32252988-f2bf-4e25-adfe-fcc8ea12528d'} May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:56.311471 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.312903 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:16:56.314730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:56.314730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-978088ea-c590-4781-ad00-479e02a5f957 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 404 len: 111 microversion: 2.20 time: 0.031922 May 10 14:16:56.314730 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 523/1025] 10.222.0.32 () {60 vars in 1279 bytes} [Tue May 10 14:16:56 2022] DELETE /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:16:56.320517 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:16:56.321309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] [instance: 32252988-f2bf-4e25-adfe-fcc8ea12528d] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:16:56.329845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.330773 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.331765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:16:56.332339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:16:56.356939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] HTTP exception thrown: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Request method failure captured: May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d HTTP/1.1 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienIY7i77ben4QV5TiXXMGiAK-urabTFcA5C0zWbeBaBCfQYxUmENXNKgBWEGBFtQ4v91zbwUy8OCz6e6HZw9-DtTe2lpkOcNJIGIMUegvy5TKLAtwDsW6ZyM1saJDFvA9eYR_kYdKrq16OjXFy_80RBFDG33e1JqUsp6O7bfzsk7jsE May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Openstack-Nova-Api-Version: 2.20 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:16:56.359323 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/c251b9c401c6455da95be74c9119b8d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_c251b9c401c6455da95be74c9119b8d2", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: c251b9c401c6455da95be74c9119b8d2 May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-661600631 May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: 3069e17bfc5d4e34ab7f5c61f48d9f11 May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-AttachVolumeShelveTestJSON-661600631-project May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.362983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '32252988-f2bf-4e25-adfe-fcc8ea12528d'} May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:16:56.364143 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. May 10 14:16:56.365845 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:16:56.368020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] Returning 404 to user: Instance 32252988-f2bf-4e25-adfe-fcc8ea12528d could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:16:56.368020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-751659c5-b9f0-4eff-ba68-752e2b657f59 tempest-AttachVolumeShelveTestJSON-661600631 tempest-AttachVolumeShelveTestJSON-661600631-project] 10.222.0.32 "GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d" status: 404 len: 111 microversion: 2.20 time: 0.045113 May 10 14:16:56.368020 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 503/1026] 10.222.0.32 () {60 vars in 1276 bytes} [Tue May 10 14:16:56 2022] GET /compute/v2.1/servers/32252988-f2bf-4e25-adfe-fcc8ea12528d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 14:17:53.742944 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-cc311fa0-09d4-4b41-ad1a-18dfc115e569 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'create', calling method: .version_select at 0x7efd562274c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-777399228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmyw+ii/f1q5cp6p6NDmf3fRVsJnsdtnNcohXnXm22Wad2c0pFQl1x1XXOY8+N41zPXwzIiewVJjb91RoTYgd3go/mo+PQmRW3F1MtYVVDvCp1u8W5qZejWePIryCBSoA=="}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:53.757402 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-cc311fa0-09d4-4b41-ad1a-18dfc115e569 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Getting quotas for project 18c7a906c7bf4b5fbc769d1d77e50e44. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:53.761224 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-cc311fa0-09d4-4b41-ad1a-18dfc115e569 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Getting quotas for user 06330ab526264eaab0ee1454d30378b0 and project 18c7a906c7bf4b5fbc769d1d77e50e44. Resources: {'key_pairs'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:53.786092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-cc311fa0-09d4-4b41-ad1a-18dfc115e569 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047668 May 10 14:17:53.786714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 524/1027] 10.222.0.32 () {60 vars in 1158 bytes} [Tue May 10 14:17:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:17:53.888299 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-528450124", "imageRef": "cd08658f-0c4e-4537-9f4f-ea01b1f101d1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-777399228", "networks": [{"uuid": "70068206-86eb-428a-8fc8-6b9da531ad32"}]}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:17:53.951309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.network.neutron [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] validate_networks() for [('70068206-86eb-428a-8fc8-6b9da531ad32', None, None, None, None, None)] {{(pid=117185) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:17:54.325867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Flavor limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:17:54.326325 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Image limits 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:17:54.326808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Flavor pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:17:54.327219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Image pref 0:0:0 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:17:54.327674 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.virt.hardware [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117185) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:17:54.337493 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.337956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.338809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:54.339254 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:54.356244 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Getting quotas for project 18c7a906c7bf4b5fbc769d1d77e50e44. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:17:54.360196 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.quota [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Getting quotas for user 06330ab526264eaab0ee1454d30378b0 and project 18c7a906c7bf4b5fbc769d1d77e50e44. Resources: {'cores', 'instances', 'ram'} {{(pid=117185) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:17:54.373342 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Going to run 1 instances... {{(pid=117185) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:17:54.376028 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cd08658f-0c4e-4537-9f4f-ea01b1f101d1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117185) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:17:54.422945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3deae83e-cbe0-40b0-868a-fb34bde26867 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538620 May 10 14:17:54.423572 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 504/1028] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 14:17:54.433698 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d3120333-ddae-48c6-a4e6-67e9f18cfafe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:54.434453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d3120333-ddae-48c6-a4e6-67e9f18cfafe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:54.489552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d3120333-ddae-48c6-a4e6-67e9f18cfafe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:54.499415 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d3120333-ddae-48c6-a4e6-67e9f18cfafe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1257 microversion: 2.1 time: 0.069496 May 10 14:17:54.500558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 525/1029] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:17:54 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:55.518777 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:55.519337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:55.525922 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.526427 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.527209 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:55.527651 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:55.597253 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:55.605246 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-3e456f29-1bdd-4904-b00a-975bdd6e40c5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1315 microversion: 2.1 time: 0.091712 May 10 14:17:55.605984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 505/1030] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:17:55 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1315 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:56.625555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:56.626341 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:56.640527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.641480 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.643040 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:56.654957 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:56.803120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:56.811193 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-833e2006-093f-4ff9-b30a-90bb39f1b753 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.189850 May 10 14:17:56.811937 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 526/1031] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:17:56 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:17:57.830888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:57.832472 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:57.845952 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.849077 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:57.850141 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:57.851327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:58.031317 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:58.042937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-44ab4fc2-46bb-4174-9e1d-a5ae52195084 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.217297 May 10 14:17:58.054293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 506/1032] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:17:57 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:17:59.066117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:17:59.067985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:17:59.073616 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.074106 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.074926 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:17:59.075365 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:17:59.233876 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:17:59.241546 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c009913a-a47f-43ef-80ad-2a4afcb6b0ab tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.180402 May 10 14:17:59.242131 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 527/1033] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:17:59 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:00.259577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:00.260218 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:00.266703 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.267174 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.267972 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:00.269061 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:00.405705 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:00.416489 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bb6bd14a-7ed0-4c8b-bb8b-933bca6fde85 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.160765 May 10 14:18:00.417523 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 507/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:00 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:01.454142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:01.454994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:01.463133 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.463594 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.464386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:01.464827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:01.615226 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:01.623411 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9218de85-af9a-4804-8fe4-e54d3d3b7134 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.175261 May 10 14:18:01.624498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 528/1035] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:01 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:02.641239 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:02.641875 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:02.648900 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.649353 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.650157 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:02.650656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:02.793958 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:02.802802 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-265d5bf4-4662-427b-9db3-cb11694ef3fe tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.165572 May 10 14:18:02.803612 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 508/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:02 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:03.821654 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:03.822395 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:03.829231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.829731 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:03.830540 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:03.831726 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:03.965668 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:03.973100 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f989dcf4-f95c-4bda-9ef1-9cdf89566f71 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.155726 May 10 14:18:03.973669 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 529/1037] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:03 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:04.991448 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:04.992051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:04.998549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:04.999007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:04.999781 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:05.000482 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:05.133455 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:05.140846 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b47df71a-fd03-4fbf-b289-6518858dc8a5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.154217 May 10 14:18:05.141412 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 509/1038] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:04 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:06.161634 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:06.162581 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:06.171486 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.172013 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.172856 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:06.173347 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:06.371397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:06.382080 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9962c3b9-263f-4a0c-a7be-22847e3d6c2c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.226523 May 10 14:18:06.383454 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 530/1039] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:06 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:07.406018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:07.406697 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:07.413314 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.413767 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.414682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.414988 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.467479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-425ed4f4-4b24-4328-9a39-6558e445c6f2 req-bde6afe3-a423-42b5-8e43-dae0e28093df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:07.476791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-425ed4f4-4b24-4328-9a39-6558e445c6f2 req-bde6afe3-a423-42b5-8e43-dae0e28093df service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:07.477538 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-425ed4f4-4b24-4328-9a39-6558e445c6f2 req-bde6afe3-a423-42b5-8e43-dae0e28093df service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:07.497434 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-425ed4f4-4b24-4328-9a39-6558e445c6f2 req-bde6afe3-a423-42b5-8e43-dae0e28093df service nova] Creating event network-changed:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:18:07.504583 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-425ed4f4-4b24-4328-9a39-6558e445c6f2 req-bde6afe3-a423-42b5-8e43-dae0e28093df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202498 May 10 14:18:07.505211 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 510/1040] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:07.582112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:07.589614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d33c09ba-abc0-4c9d-8f34-b4ee28137f01 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.187431 May 10 14:18:07.590188 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 531/1041] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:07 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:08.608092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:08.608800 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:08.616045 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.616503 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.617280 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:08.617720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:08.751843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:08.759924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-ae047dcc-18a7-4686-a2e6-c805c360d04e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.156062 May 10 14:18:08.760492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 511/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:08 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:09.776976 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:09.777607 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:09.785499 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:09.785965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:09.786801 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:09.787251 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:09.932867 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:09.940752 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-39613da4-3083-45bf-bb33-2f88ac2f71a9 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.167472 May 10 14:18:09.941416 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 532/1043] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:09 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:10.957818 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:10.958714 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:10.965178 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.965640 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:10.966481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:10.966942 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.102307 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:11.109580 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5d7a7adf-d25d-487c-ad69-221f711bbd03 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.155949 May 10 14:18:11.110079 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 512/1044] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:10 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:11.853661 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-139e1d82-2c33-476e-8362-4693ed93f33a req-46c456fe-f9c5-4e7c-bb1d-82bf9ab19a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "name": "network-vif-plugged", "status": "completed", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:11.868159 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-139e1d82-2c33-476e-8362-4693ed93f33a req-46c456fe-f9c5-4e7c-bb1d-82bf9ab19a19 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:11.868612 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-139e1d82-2c33-476e-8362-4693ed93f33a req-46c456fe-f9c5-4e7c-bb1d-82bf9ab19a19 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:11.881906 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-139e1d82-2c33-476e-8362-4693ed93f33a req-46c456fe-f9c5-4e7c-bb1d-82bf9ab19a19 service nova] Creating event network-vif-plugged:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:18:11.887394 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-139e1d82-2c33-476e-8362-4693ed93f33a req-46c456fe-f9c5-4e7c-bb1d-82bf9ab19a19 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041981 May 10 14:18:11.888028 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 533/1045] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:12.127294 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:12.128587 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:12.135521 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.135967 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.136735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:12.137165 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:12.274962 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:12.282706 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bce92bff-076f-4dfe-bf6c-ac87bb0a7d2d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.159522 May 10 14:18:12.283272 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 513/1046] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:12 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:13.301507 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:13.302131 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:13.308231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.308681 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.309460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:13.309896 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:13.442800 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:13.450495 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3d2ccf69-b60a-44f8-85c4-63e0363be519 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1357 microversion: 2.1 time: 0.154300 May 10 14:18:13.451089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 534/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:13 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:18:14.468011 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:14.468704 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:14.475811 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.476266 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.477062 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.477508 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.614637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:14.622287 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-43953b96-50eb-4250-8aa1-d946d94ae95a tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1548 microversion: 2.1 time: 0.158354 May 10 14:18:14.623265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 514/1048] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:14 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:14.639815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:14.640431 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:14.647344 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.647792 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.648558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.648989 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.782350 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:14.790873 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-0145de26-99a8-45a6-8770-40fb52ba0af4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1548 microversion: 2.1 time: 0.155386 May 10 14:18:14.791441 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 535/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:14 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:14.806977 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:14.810939 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:14.811472 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Searching by: {'deleted': False, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44'} {{(pid=117185) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 14:18:14.819158 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.819608 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.820410 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:14.820848 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:14.915837 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.multi_cell_list [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117185) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 14:18:15.008914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-12607758-8fad-4045-91ba-754f9b61d317 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.205668 May 10 14:18:15.009506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 515/1050] 10.222.0.32 () {58 vars in 1124 bytes} [Tue May 10 14:18:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:15.019952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:15.020670 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:15.027322 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:15.027775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:15.028554 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:15.028996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:15.156742 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:15.164583 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-6ec72e93-da07-4bd5-b87a-15d09e34ef72 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1548 microversion: 2.1 time: 0.148711 May 10 14:18:15.165157 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 536/1051] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:15 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:16.700831 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "287096b8-863a-478c-a863-b48ae6cb0f22"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:16.701885 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:16.709186 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.709642 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.710475 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:16.710923 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:16.955492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-c0530cf5-2d5b-47fe-aab0-9994c0dd9082 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258461 May 10 14:18:16.956094 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 516/1052] 10.222.0.32 () {60 vars in 1322 bytes} [Tue May 10 14:18:16 2022] POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:24.498682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:24.499325 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:24.506586 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:24.507074 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:24.507879 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:24.508342 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:24.648834 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:24.656714 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-33549511-08a9-469c-9aca-ccdb2667b6c1 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1594 microversion: 2.1 time: 0.162008 May 10 14:18:24.657278 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 537/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:24 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:18:26.711809 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-56e5c01d-1344-4092-a66a-87cc8f58057a req-12636459-a515-45ee-a4e0-11b466c5ce76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:26.720391 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-56e5c01d-1344-4092-a66a-87cc8f58057a req-12636459-a515-45ee-a4e0-11b466c5ce76 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:26.721037 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-56e5c01d-1344-4092-a66a-87cc8f58057a req-12636459-a515-45ee-a4e0-11b466c5ce76 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:26.743238 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-56e5c01d-1344-4092-a66a-87cc8f58057a req-12636459-a515-45ee-a4e0-11b466c5ce76 service nova] Creating event network-changed:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:18:26.749472 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-56e5c01d-1344-4092-a66a-87cc8f58057a req-12636459-a515-45ee-a4e0-11b466c5ce76 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111207 May 10 14:18:26.750813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 517/1054] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:28.700304 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1623049746"}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:28.701142 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:28.711774 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:28.712756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:28.713776 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:28.714425 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:28.893796 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.network.security_group_api [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Adding security group 7efb6b90-98db-4eb3-ac7c-33338d0ec170 to port 271d74ad-152d-4bda-a153-00a1d845101b May 10 14:18:29.373761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f810e304-b383-4132-ab4f-f0e8211b4eb6 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action" status: 202 len: 0 microversion: 2.1 time: 0.679580 May 10 14:18:29.378493 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 538/1055] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:18:28 2022] POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:18:29.385359 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:18:29.391759 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-7db3c50e-2c92-47a6-a5a0-7d32226c578e req-b269045b-e182-477d-b84c-5d49b6658221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:18:29.392136 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:18:29.403514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:29.405698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:29.409351 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:29.409808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:29.416132 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-7db3c50e-2c92-47a6-a5a0-7d32226c578e req-b269045b-e182-477d-b84c-5d49b6658221 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:18:29.416571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-7db3c50e-2c92-47a6-a5a0-7d32226c578e req-b269045b-e182-477d-b84c-5d49b6658221 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:18:29.446153 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-7db3c50e-2c92-47a6-a5a0-7d32226c578e req-b269045b-e182-477d-b84c-5d49b6658221 service nova] Creating event network-changed:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:18:29.452545 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-7db3c50e-2c92-47a6-a5a0-7d32226c578e req-b269045b-e182-477d-b84c-5d49b6658221 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064772 May 10 14:18:29.453452 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 539/1056] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:18:29.763575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:18:29.763575 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:18:29.788496 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:18:29.805339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-44db13ee-e267-4de7-a959-f8e646da0bb4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1759 microversion: 2.1 time: 0.424018 May 10 14:18:29.806443 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 518/1057] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:18:29 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1759 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:14.524590 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-975153055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102038041", "security_groups": [{"name": "tempest-secgroup-smoke-153034832"}], "block_device_mapping_v2": [{"uuid": "c9509a1a-356b-48da-a0f6-294311c941da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af"}]}} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:14.641366 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.network.neutron [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] validate_networks() for [('7e9d1ba6-673f-40ea-bbdc-6d7d8acd63af', None, None, None, None, None)] {{(pid=117186) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 14:19:15.055815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 14:19:15.056231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image limits 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 14:19:15.056695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Flavor pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 14:19:15.057092 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Image pref 0:0:0 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 14:19:15.057494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.virt.hardware [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 14:19:15.066894 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:15.067334 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:15.068122 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:15.068552 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:15.085063 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 14:19:15.088824 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.quota [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Getting quotas for user da9685af6f6f47c8a59fb93df9bd0ec1 and project 6350c410027a478988e364b17696da95. Resources: {'cores', 'instances', 'ram'} {{(pid=117186) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 14:19:15.145710 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Going to run 1 instances... {{(pid=117186) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 14:19:15.147910 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c9509a1a-356b-48da-a0f6-294311c941da',volume_size=None,volume_type=None)] {{(pid=117186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 14:19:15.274815 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f9a2f733-2038-4042-a61a-03423899b567 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.755043 May 10 14:19:15.275457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 540/1058] 10.222.0.32 () {60 vars in 1146 bytes} [Tue May 10 14:19:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 14:19:15.286291 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dd632ab8-df47-4275-9568-b977187aeb98 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:15.287549 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dd632ab8-df47-4275-9568-b977187aeb98 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:15.342822 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dd632ab8-df47-4275-9568-b977187aeb98 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:15.349344 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dd632ab8-df47-4275-9568-b977187aeb98 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1094 microversion: 2.1 time: 0.067229 May 10 14:19:15.349921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 519/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:15 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:16.367055 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:16.367735 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:16.378795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:16.379246 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:16.380244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:16.380868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:16.466956 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:16.475111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-03c1159f-8216-46bc-a233-93f975661d9b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1200 microversion: 2.1 time: 0.112660 May 10 14:19:16.475705 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 541/1060] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:16 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1200 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:17.493661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:17.494470 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:17.504616 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:17.507292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:17.507292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:17.507292 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:17.754514 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:17.764456 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5347460e-ef2c-4caa-bf8d-dbbfd5db15df tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.275113 May 10 14:19:17.765279 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 520/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:17 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:17.923258 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-550d3cd4-5f54-4cf0-bd41-36f9b0f88ed8 req-73a1e881-111d-4431-acbb-db81b2605bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91745951-0edd-45ed-895c-9d0972664abb", "tag": "bf872880-2b36-4cfa-a2fa-29b0acad661e"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:17.938550 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-550d3cd4-5f54-4cf0-bd41-36f9b0f88ed8 req-73a1e881-111d-4431-acbb-db81b2605bd6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:17.939068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-550d3cd4-5f54-4cf0-bd41-36f9b0f88ed8 req-73a1e881-111d-4431-acbb-db81b2605bd6 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:17.962111 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-550d3cd4-5f54-4cf0-bd41-36f9b0f88ed8 req-73a1e881-111d-4431-acbb-db81b2605bd6 service nova] Creating event network-changed:bf872880-2b36-4cfa-a2fa-29b0acad661e for instance 91745951-0edd-45ed-895c-9d0972664abb on hv-cinder-83588 May 10 14:19:17.970801 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-550d3cd4-5f54-4cf0-bd41-36f9b0f88ed8 req-73a1e881-111d-4431-acbb-db81b2605bd6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051518 May 10 14:19:17.972030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 542/1062] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:18.783663 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:18.784363 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:18.790806 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:18.791265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:18.792049 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:18.792495 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:18.934914 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:18.944093 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f091a028-9621-4a87-9629-8ff18e9386d4 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.164896 May 10 14:19:18.944690 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 521/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:18 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:19.968829 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:19.969489 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:19.975945 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:19.976399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:19.977172 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:19.977608 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:20.130653 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:20.138996 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-c0ca4a46-59cd-428f-b812-9ad6cafebd0f tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.174988 May 10 14:19:20.139560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 543/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:19 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:19:21.156710 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:21.157255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:21.163335 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:21.163790 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:21.164574 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:21.165018 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:21.307206 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:21.315572 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5b650aa6-5f0e-4a60-9edd-f1968056a64d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.163596 May 10 14:19:21.316173 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 522/1065] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:21 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:22.332994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:22.333613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:22.340780 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:22.341231 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:22.342006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:22.342474 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:22.475917 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:22.483878 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d38da8ee-6904-489b-a1fc-f0df10caa520 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.154766 May 10 14:19:22.484460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 544/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:22 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:23.500870 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:23.501618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:23.507918 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:23.508366 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:23.509164 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:23.509601 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:23.643380 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:23.650873 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-90adec65-0003-44d6-b0c3-cc7b0e8658ec tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.154436 May 10 14:19:23.651445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 523/1067] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:23 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:19:24.669640 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:24.670401 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:24.676789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:24.677244 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:24.678027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:24.678494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:24.819187 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:24.826768 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-bfe29d78-9a56-48b7-b1b0-5a5520ff7aac tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.162180 May 10 14:19:24.827332 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 545/1068] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:24 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:25.844352 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:25.844961 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:25.851492 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:25.851983 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:25.852766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:25.853205 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:25.986392 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:25.993802 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6b589ad3-0b13-4238-b87f-44162dd583c2 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.153329 May 10 14:19:25.994405 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 524/1069] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:25 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:27.011795 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:27.012460 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:27.019570 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:27.020029 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:27.020828 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:27.021272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:27.161961 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:27.171179 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-975b7e5e-3c31-475b-8e8d-e148d683ca6e tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.163006 May 10 14:19:27.171434 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 546/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:27 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:28.188817 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:28.189535 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:28.196070 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:28.196522 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:28.197298 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:28.197735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:28.338768 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:28.347007 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-5cd06efa-0f86-4ccb-a277-b3e00c0e4a03 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.162435 May 10 14:19:28.347597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 525/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:28 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:29.365492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:29.366099 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:29.373418 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:29.373868 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:29.374688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:29.375127 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:29.513457 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:29.520919 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b9f5a02b-3e82-46a1-946b-a9c9ca0d63ed tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.159400 May 10 14:19:29.521525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 547/1072] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:29 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:30.231436 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-c50625ab-9ad7-4501-bedb-ee21c08b6c71 req-e9dcb789-44d4-464e-a857-fdf22cfa6115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91745951-0edd-45ed-895c-9d0972664abb", "name": "network-vif-plugged", "status": "completed", "tag": "bf872880-2b36-4cfa-a2fa-29b0acad661e"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:30.241503 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c50625ab-9ad7-4501-bedb-ee21c08b6c71 req-e9dcb789-44d4-464e-a857-fdf22cfa6115 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:30.241956 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-c50625ab-9ad7-4501-bedb-ee21c08b6c71 req-e9dcb789-44d4-464e-a857-fdf22cfa6115 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:30.254430 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-c50625ab-9ad7-4501-bedb-ee21c08b6c71 req-e9dcb789-44d4-464e-a857-fdf22cfa6115 service nova] Creating event network-vif-plugged:bf872880-2b36-4cfa-a2fa-29b0acad661e for instance 91745951-0edd-45ed-895c-9d0972664abb on hv-cinder-83588 May 10 14:19:30.259648 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-c50625ab-9ad7-4501-bedb-ee21c08b6c71 req-e9dcb789-44d4-464e-a857-fdf22cfa6115 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095731 May 10 14:19:30.260259 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 526/1073] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:19:30.537008 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:30.537809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:30.545030 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:30.545487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:30.546305 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:30.546749 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:30.685274 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:30.692695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ca5c82dc-7900-4ed4-b1f1-95a012b01f85 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.159677 May 10 14:19:30.693260 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 548/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:30 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:31.712708 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:31.713418 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:31.720984 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:31.721445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:31.722253 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:31.722698 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:31.862955 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:31.870548 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-65c5b3d7-8abd-46af-b656-f3ec0bc0f1dc tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1265 microversion: 2.1 time: 0.162540 May 10 14:19:31.871232 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 527/1075] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:31 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:32.888920 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:32.889527 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:32.897105 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:32.897560 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:32.898419 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:32.898867 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:33.052532 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:33.065027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3881858f-33d0-4fab-9f29-1a66c511a0c3 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1450 microversion: 2.1 time: 0.180633 May 10 14:19:33.065614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 549/1076] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:32 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:33.082336 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:33.083066 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:33.091479 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:33.091930 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:33.092731 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:33.093172 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:33.233848 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:33.241700 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e8531e87-497f-4df5-829c-0a7e15360021 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1450 microversion: 2.1 time: 0.163606 May 10 14:19:33.242312 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 528/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:33 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:35.302778 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-4fa2e12f-53ad-47ab-b3e2-de3379852d63 req-130d4681-84d5-4621-b1bd-0f2f56c997c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91745951-0edd-45ed-895c-9d0972664abb", "tag": "bf872880-2b36-4cfa-a2fa-29b0acad661e"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:35.312051 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-4fa2e12f-53ad-47ab-b3e2-de3379852d63 req-130d4681-84d5-4621-b1bd-0f2f56c997c3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:35.312503 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-4fa2e12f-53ad-47ab-b3e2-de3379852d63 req-130d4681-84d5-4621-b1bd-0f2f56c997c3 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:35.324525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-4fa2e12f-53ad-47ab-b3e2-de3379852d63 req-130d4681-84d5-4621-b1bd-0f2f56c997c3 service nova] Creating event network-changed:bf872880-2b36-4cfa-a2fa-29b0acad661e for instance 91745951-0edd-45ed-895c-9d0972664abb on hv-cinder-83588 May 10 14:19:35.330119 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-4fa2e12f-53ad-47ab-b3e2-de3379852d63 req-130d4681-84d5-4621-b1bd-0f2f56c997c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031222 May 10 14:19:35.330846 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 550/1078] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:19:38.796921 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:19:38.798156 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:38.805702 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:38.806171 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:38.807256 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:38.807724 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:38.891145 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e368d614-afef-4ccf-a500-e6c23bd98416 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action" status: 202 len: 0 microversion: 2.1 time: 0.099320 May 10 14:19:38.892092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 529/1079] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:19:38 2022] POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:19:38.904120 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:38.905399 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:38.917708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:38.919156 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:38.921068 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:38.921756 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:39.079582 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:39.087392 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-372ad4ca-36ca-4bde-976b-57de93d0b2fc tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1751 microversion: 2.1 time: 0.189613 May 10 14:19:39.087999 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 551/1080] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:38 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:40.110672 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:40.111282 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:40.118005 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:40.118504 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:40.119338 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:40.119782 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:40.311227 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:40.321348 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-15ec1b8d-e9e5-4d28-8916-663f116f4228 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.215187 May 10 14:19:40.322112 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 530/1081] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:40 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:41.340951 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:41.341614 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:41.348147 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:41.348664 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:41.349443 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:41.349941 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:41.531935 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:41.541139 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-57ac19e5-b577-4a2f-a701-d869aeea2125 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.204873 May 10 14:19:41.541706 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 552/1082] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:41 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:42.560255 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:42.561059 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:42.567887 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:42.568339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:42.569175 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:42.569553 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:42.752661 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:42.763718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-881cf81a-4402-4d5b-91df-39d808d16667 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.207621 May 10 14:19:42.764303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 531/1083] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:42 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:43.789918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:43.790694 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:43.801632 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:43.802091 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:43.802914 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:43.803389 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:43.986006 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:43.997533 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-5c69c6b4-4db0-45c7-9e27-25c0e0e3810b tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.212824 May 10 14:19:43.998136 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 553/1084] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:43 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:45.018311 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:45.018971 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:45.026149 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:45.026707 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:45.027592 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:45.028038 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:45.187481 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:45.196187 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-8282662d-8baf-4b3b-b615-0833e0882e8f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.181952 May 10 14:19:45.196763 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 532/1085] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:45 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:46.215592 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:46.216265 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:46.224089 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:46.224477 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:46.225293 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:46.225887 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:46.390336 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:46.398316 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-a22c7e6e-b2c4-41bc-b264-8064dc366f9f tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.188057 May 10 14:19:46.398905 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 554/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:46 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:47.419937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:47.420843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:47.428288 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:47.428720 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:47.429513 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:47.429959 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:47.598293 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:47.607146 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-e636299a-3ecb-4ac9-81b1-c6b25125e9f4 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.193119 May 10 14:19:47.607765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 533/1087] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:47 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:48.627784 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:48.628539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:48.635129 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.635588 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.636918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:48.637688 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:48.801823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:48.811135 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-d6ef85f2-4dd0-41ab-b297-8633b5b28b63 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.188682 May 10 14:19:48.811715 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 555/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:48 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:19:49.828096 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:49.828909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:49.836388 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:49.836843 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:49.837628 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:49.838065 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:49.997718 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:50.006810 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-dab76764-f4ec-4916-a31c-7f5ab6c02ce7 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1756 microversion: 2.1 time: 0.182607 May 10 14:19:50.007402 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 534/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:49 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:19:51.025300 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:19:51.025904 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:19:51.032514 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:51.032958 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:51.033809 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:19:51.034272 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:19:51.200037 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:19:51.208473 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b03be4ba-15b8-4c6e-b292-ffd21753234c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1759 microversion: 2.1 time: 0.187267 May 10 14:19:51.209049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 556/1090] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:19:51 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1759 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:20:05.905692 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:20:05.906581 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:20:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:20:55.696635 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:20:55.697558 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:20:56.830813 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1623049746"}} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:56.831469 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:56.841909 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.842426 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:56.848432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:56.848432 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.023808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.network.security_group_api [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Removing security group 7efb6b90-98db-4eb3-ac7c-33338d0ec170 from port 271d74ad-152d-4bda-a153-00a1d845101b May 10 14:20:57.515197 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-943a67c1-2db1-4a29-b4d6-6f4d2f7ee13c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action" status: 202 len: 0 microversion: 2.1 time: 0.688923 May 10 14:20:57.531380 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 535/1091] 10.222.0.32 () {60 vars in 1277 bytes} [Tue May 10 14:20:56 2022] POST /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:20:57.539931 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-cce023c3-5ab9-43e1-8419-a0818886aa86 req-ec1a1aa2-ab44-4f51-8eb6-12e98de9de15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:57.559075 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-cce023c3-5ab9-43e1-8419-a0818886aa86 req-ec1a1aa2-ab44-4f51-8eb6-12e98de9de15 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:57.560383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-cce023c3-5ab9-43e1-8419-a0818886aa86 req-ec1a1aa2-ab44-4f51-8eb6-12e98de9de15 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:57.577553 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-cce023c3-5ab9-43e1-8419-a0818886aa86 req-ec1a1aa2-ab44-4f51-8eb6-12e98de9de15 service nova] Creating event network-changed:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:20:57.583613 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-cce023c3-5ab9-43e1-8419-a0818886aa86 req-ec1a1aa2-ab44-4f51-8eb6-12e98de9de15 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058060 May 10 14:20:57.584577 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 557/1092] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:20:59.576597 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:59.577394 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:59.587303 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.587924 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.589778 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.590747 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.605076 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-dcd90f81-bc80-41b8-b4ef-679744d20914 req-f5da8261-6b20-4af2-97e0-9ecf514e880e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:20:59.616229 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-dcd90f81-bc80-41b8-b4ef-679744d20914 req-f5da8261-6b20-4af2-97e0-9ecf514e880e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.616827 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-dcd90f81-bc80-41b8-b4ef-679744d20914 req-f5da8261-6b20-4af2-97e0-9ecf514e880e service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.629610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-dcd90f81-bc80-41b8-b4ef-679744d20914 req-f5da8261-6b20-4af2-97e0-9ecf514e880e service nova] Creating event network-changed:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:20:59.635201 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-dcd90f81-bc80-41b8-b4ef-679744d20914 req-f5da8261-6b20-4af2-97e0-9ecf514e880e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035548 May 10 14:20:59.636610 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 558/1093] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 14:20:59.730861 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.objects.instance [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lazy-loading 'services' on Instance uuid 11b9c290-4771-465a-b21d-22a768285953 {{(pid=117185) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:20:59.871666 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a2cf8dfa-af9f-4439-865d-f394a37b3a48 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments/287096b8-863a-478c-a863-b48ae6cb0f22" status: 202 len: 0 microversion: 2.1 time: 0.302746 May 10 14:20:59.873046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 536/1094] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:20:59 2022] DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments/287096b8-863a-478c-a863-b48ae6cb0f22 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:20:59.898946 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:20:59.900708 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:20:59.915131 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.918009 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.922943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:20:59.924162 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:20:59.985390 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8ffc2861-8c70-47c3-a890-1df111d00aea tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096365 May 10 14:20:59.986874 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 559/1095] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:20:59 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:01.005349 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:01.007194 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:01.018095 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.018774 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.020040 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.020215 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.057091 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-97a271ce-bfeb-4e57-a254-57dadb30500c tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059818 May 10 14:21:01.058084 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 537/1096] 10.222.0.32 () {58 vars in 1301 bytes} [Tue May 10 14:21:00 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 14:21:01.069555 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:01.070466 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:01.078930 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.079568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.080513 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:01.081451 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:01.194571 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] HTTP exception thrown: Instance 11b9c290-4771-465a-b21d-22a768285953 is not attached to volume 287096b8-863a-478c-a863-b48ae6cb0f22 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Request method failure captured: May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments/287096b8-863a-478c-a863-b48ae6cb0f22 HTTP/1.1 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienQBf4Bd-GdZWp7vSHTzHVqk1oArzWiANw8lZhHAGQIodH2X0y2Z7_I8esWwwSv5Ypo1vh3unq4k6Neh50mIKnW1aAAAlZIxNhLkwz6KgUAKe-bvRjYBWTpn_1N6hHwFeWYNmKJ_ntkW90IwRiyIg4udyjz3ZnBefatnA6XBKxfsINY May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 18c7a906c7bf4b5fbc769d1d77e50e44 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:21:01.199356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_18c7a906c7bf4b5fbc769d1d77e50e44", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 18c7a906c7bf4b5fbc769d1d77e50e44 May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-TestMinimumBasicScenario-1672490426-project May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 06330ab526264eaab0ee1454d30378b0 May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-TestMinimumBasicScenario-1672490426-project May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:21:01.201250 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 11b9c290-4771-465a-b21d-22a768285953 is not attached to volume 287096b8-863a-478c-a863-b48ae6cb0f22 May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'server_id': '11b9c290-4771-465a-b21d-22a768285953', 'id': '287096b8-863a-478c-a863-b48ae6cb0f22'} May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 287096b8-863a-478c-a863-b48ae6cb0f22. May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:01.203239 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b9c290-4771-465a-b21d-22a768285953 is not attached to volume 287096b8-863a-478c-a863-b48ae6cb0f22 May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b9c290-4771-465a-b21d-22a768285953 is not attached to volume 287096b8-863a-478c-a863-b48ae6cb0f22 May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:01.208243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Returning 404 to user: Instance 11b9c290-4771-465a-b21d-22a768285953 is not attached to volume 287096b8-863a-478c-a863-b48ae6cb0f22 {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:01.211645 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-eeafc858-d541-4e86-a442-765c0c741432 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments/287096b8-863a-478c-a863-b48ae6cb0f22" status: 404 len: 154 microversion: 2.1 time: 0.136247 May 10 14:21:01.211645 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 560/1097] 10.222.0.32 () {58 vars in 1415 bytes} [Tue May 10 14:21:01 2022] DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953/os-volume_attachments/287096b8-863a-478c-a863-b48ae6cb0f22 => generated 154 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:02.385395 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:02.386769 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:02.393098 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.393555 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.394896 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.395384 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.426126 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Going to try to terminate instance {{(pid=117185) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:21:02.549761 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-91131227-53ca-4ac6-a7d5-544caf5b6d8d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 204 len: 0 microversion: 2.1 time: 0.169526 May 10 14:21:02.550385 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 538/1098] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:21:02 2022] DELETE /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:21:02.563810 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:02.564604 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:02.571982 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.572561 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.574034 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:02.574678 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:02.723429 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:02.732012 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-4dfcfcbc-5867-41fc-8f5b-ae15cff5f68e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1554 microversion: 2.1 time: 0.174419 May 10 14:21:02.732012 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 561/1099] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:02 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:03.749637 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:03.750373 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:03.757511 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.758051 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.758867 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:03.759308 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:03.903577 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:03.911309 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-b5d7a941-0473-41b9-8090-cb9281103d35 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1554 microversion: 2.1 time: 0.166444 May 10 14:21:03.911908 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 539/1100] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:03 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:04.879716 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [req-b1fde0c4-49c3-4a43-8c04-5b2d244f95e7 req-3036addb-c428-4410-87e3-bf5c33c3c938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b9c290-4771-465a-b21d-22a768285953", "name": "network-vif-deleted", "tag": "271d74ad-152d-4bda-a153-00a1d845101b"}]} {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:04.890498 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-b1fde0c4-49c3-4a43-8c04-5b2d244f95e7 req-3036addb-c428-4410-87e3-bf5c33c3c938 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.890969 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [req-b1fde0c4-49c3-4a43-8c04-5b2d244f95e7 req-3036addb-c428-4410-87e3-bf5c33c3c938 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.904029 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.compute.server_external_events [req-b1fde0c4-49c3-4a43-8c04-5b2d244f95e7 req-3036addb-c428-4410-87e3-bf5c33c3c938 service nova] Creating event network-vif-deleted:271d74ad-152d-4bda-a153-00a1d845101b for instance 11b9c290-4771-465a-b21d-22a768285953 on hv-cinder-83588 May 10 14:21:04.911145 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [req-b1fde0c4-49c3-4a43-8c04-5b2d244f95e7 req-3036addb-c428-4410-87e3-bf5c33c3c938 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 May 10 14:21:04.912380 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 562/1101] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:04.930251 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:04.931163 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:04.938945 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.940624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:04.940624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:04.940624 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:05.016327 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06330ab526264eaab0ee1454d30378b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c7a906c7bf4b5fbc769d1d77e50e44', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:05.026730 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-12ab9fa3-ae57-4aa0-9b93-907a1815865d tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 200 len: 1342 microversion: 2.1 time: 0.100480 May 10 14:21:05.027509 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 540/1102] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:04 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:06.046720 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:06.047496 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] [instance: 11b9c290-4771-465a-b21d-22a768285953] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:06.054725 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.055183 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.055980 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:06.056453 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:06.074659 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] HTTP exception thrown: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Request method failure captured: May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 HTTP/1.1 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienQBf4Bd-GdZWp7vSHTzHVqk1oArzWiANw8lZhHAGQIodH2X0y2Z7_I8esWwwSv5Ypo1vh3unq4k6Neh50mIKnW1aAAAlZIxNhLkwz6KgUAKe-bvRjYBWTpn_1N6hHwFeWYNmKJ_ntkW90IwRiyIg4udyjz3ZnBefatnA6XBKxfsINY May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 18c7a906c7bf4b5fbc769d1d77e50e44 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:21:06.076360 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/18c7a906c7bf4b5fbc769d1d77e50e44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_18c7a906c7bf4b5fbc769d1d77e50e44", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 18c7a906c7bf4b5fbc769d1d77e50e44 May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1672490426 May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-TestMinimumBasicScenario-1672490426-project May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: 06330ab526264eaab0ee1454d30378b0 May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-TestMinimumBasicScenario-1672490426-project May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. May 10 14:21:06.078054 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '11b9c290-4771-465a-b21d-22a768285953'} May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:06.079184 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. May 10 14:21:06.081685 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:06.083245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Returning 404 to user: Instance 11b9c290-4771-465a-b21d-22a768285953 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:06.083245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-9c0d9743-634c-46f7-912e-451da267c76e tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953" status: 404 len: 111 microversion: 2.1 time: 0.037182 May 10 14:21:06.083245 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 563/1103] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:06 2022] GET /compute/v2.1/servers/11b9c290-4771-465a-b21d-22a768285953 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:06.087217 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-f62abb10-d33a-486d-9b5e-35052fde05b5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] Calling method '.version_select at 0x7efd5627be50>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:06.112743 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-f62abb10-d33a-486d-9b5e-35052fde05b5 tempest-TestMinimumBasicScenario-1672490426 tempest-TestMinimumBasicScenario-1672490426-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777399228" status: 202 len: 0 microversion: 2.1 time: 0.028811 May 10 14:21:06.115765 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 541/1104] 10.222.0.32 () {58 vars in 1268 bytes} [Tue May 10 14:21:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777399228 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 14:21:25.079117 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:25.079695 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:25.081473 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-2369de26-e12b-408f-8b9c-39686cab224d req-1d9f5d15-9154-44b9-8738-9819cd5f361a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91745951-0edd-45ed-895c-9d0972664abb", "tag": "bf872880-2b36-4cfa-a2fa-29b0acad661e"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:25.086112 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.086606 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.087382 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.087814 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.093652 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-2369de26-e12b-408f-8b9c-39686cab224d req-1d9f5d15-9154-44b9-8738-9819cd5f361a service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.094258 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-2369de26-e12b-408f-8b9c-39686cab224d req-1d9f5d15-9154-44b9-8738-9819cd5f361a service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.118536 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-2369de26-e12b-408f-8b9c-39686cab224d req-1d9f5d15-9154-44b9-8738-9819cd5f361a service nova] Creating event network-changed:bf872880-2b36-4cfa-a2fa-29b0acad661e for instance 91745951-0edd-45ed-895c-9d0972664abb on hv-cinder-83588 May 10 14:21:25.118833 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:21:25.122798 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-2369de26-e12b-408f-8b9c-39686cab224d req-1d9f5d15-9154-44b9-8738-9819cd5f361a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045543 May 10 14:21:25.123493 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 542/1105] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:25.232292 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-969085e6-77bf-4a19-ae14-d0c1969ac11d tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "DELETE /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 204 len: 0 microversion: 2.1 time: 0.157149 May 10 14:21:25.233960 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 564/1106] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:21:25 2022] DELETE /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:21:25.243808 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:25.245816 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:25.252035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.252561 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.253355 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:25.253797 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:25.493701 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:25.502862 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-bfb72e53-c9d8-4a5d-bc59-b0cb6247fd1a tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1575 microversion: 2.1 time: 0.263546 May 10 14:21:25.503487 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 543/1107] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:25 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1575 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:26.526072 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:26.526787 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:26.533110 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.533568 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.534386 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:26.534832 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:26.667063 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:26.674446 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-8aaa6ef0-6014-489b-9f9e-5d0e021c677c tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1575 microversion: 2.1 time: 0.152807 May 10 14:21:26.675002 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 565/1108] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:26 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:27.300446 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-f5714895-b2b0-4bdb-9e3c-f1b58eb98bdd req-f8e20e8a-8ac0-4cc4-bf30-e4f46d3a2542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91745951-0edd-45ed-895c-9d0972664abb", "name": "network-vif-deleted", "tag": "bf872880-2b36-4cfa-a2fa-29b0acad661e"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:27.311290 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-f5714895-b2b0-4bdb-9e3c-f1b58eb98bdd req-f8e20e8a-8ac0-4cc4-bf30-e4f46d3a2542 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.311791 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-f5714895-b2b0-4bdb-9e3c-f1b58eb98bdd req-f8e20e8a-8ac0-4cc4-bf30-e4f46d3a2542 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.324735 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-f5714895-b2b0-4bdb-9e3c-f1b58eb98bdd req-f8e20e8a-8ac0-4cc4-bf30-e4f46d3a2542 service nova] Creating event network-vif-deleted:bf872880-2b36-4cfa-a2fa-29b0acad661e for instance 91745951-0edd-45ed-895c-9d0972664abb on hv-cinder-83588 May 10 14:21:27.330424 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-f5714895-b2b0-4bdb-9e3c-f1b58eb98bdd req-f8e20e8a-8ac0-4cc4-bf30-e4f46d3a2542 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 May 10 14:21:27.331029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 544/1109] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:27.693027 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:27.693753 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:27.708049 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.708514 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.709375 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.709823 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.742404 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:27.742857 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:27.743310 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lazy-loading 'fault' on Instance uuid 91745951-0edd-45ed-895c-9d0972664abb {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:21:27.785487 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:27.793282 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-b53403ad-125d-4118-9f8e-c00b346cf692 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 200 len: 1230 microversion: 2.1 time: 0.104148 May 10 14:21:27.793866 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 566/1110] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:27 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:28.812029 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:28.812634 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 91745951-0edd-45ed-895c-9d0972664abb] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:28.818993 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.819445 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.820219 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:28.820656 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:28.834607 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] HTTP exception thrown: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Request method failure captured: May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb HTTP/1.1 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienL2NnrYT5F7KUoDFS1gtWw8idP-pytSjh3HooGNi8y2-bRe_KUDm94O9hnxzyn99mZLb4Qc2qqRnRBCv5VJV45_LasehH7RD2ZNe_PsaJJTAXoiROVT2TGpN5W23wwdi3ZYeIFO4avCbYPTyji6GqbETtxVt-U3ufAvIIuqKvybic4 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 6350c410027a478988e364b17696da95 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:21:28.836340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/6350c410027a478988e364b17696da95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_6350c410027a478988e364b17696da95", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-TestVolumeBootPattern-993200433 May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 6350c410027a478988e364b17696da95 May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: da9685af6f6f47c8a59fb93df9bd0ec1 May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. May 10 14:21:28.839525 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '91745951-0edd-45ed-895c-9d0972664abb'} May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:28.840599 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. May 10 14:21:28.842484 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:28.844035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Returning 404 to user: Instance 91745951-0edd-45ed-895c-9d0972664abb could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:28.844035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-135885ef-fe48-47c9-b40e-8587f23d9dc5 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb" status: 404 len: 111 microversion: 2.1 time: 0.031452 May 10 14:21:28.844035 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 545/1111] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:28 2022] GET /compute/v2.1/servers/91745951-0edd-45ed-895c-9d0972664abb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:31.992494 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:31.993836 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:31.995012 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-5db8550a-eedf-4565-b312-aa53e8e4c9c6 req-b25033fc-ba09-4345-9e89-03f60df8c612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21d89cd9-9357-40e8-912a-aacd29e0250f", "tag": "f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:32.002243 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.002952 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.003737 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.003888 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-5db8550a-eedf-4565-b312-aa53e8e4c9c6 req-b25033fc-ba09-4345-9e89-03f60df8c612 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.004339 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-5db8550a-eedf-4565-b312-aa53e8e4c9c6 req-b25033fc-ba09-4345-9e89-03f60df8c612 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.004620 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.017071 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-5db8550a-eedf-4565-b312-aa53e8e4c9c6 req-b25033fc-ba09-4345-9e89-03f60df8c612 service nova] Creating event network-changed:f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd for instance 21d89cd9-9357-40e8-912a-aacd29e0250f on hv-cinder-83588 May 10 14:21:32.022665 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-5db8550a-eedf-4565-b312-aa53e8e4c9c6 req-b25033fc-ba09-4345-9e89-03f60df8c612 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 May 10 14:21:32.023283 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 546/1112] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:32.042180 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Going to try to terminate instance {{(pid=117186) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 14:21:32.140086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-61333870-173c-4dc0-995d-fe65ed15e02b tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "DELETE /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 204 len: 0 microversion: 2.1 time: 0.151397 May 10 14:21:32.142965 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 567/1113] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:21:31 2022] DELETE /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 14:21:32.152067 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:32.153092 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:32.160133 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.160684 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.161753 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:32.162265 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:32.335589 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.policy [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117185) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:32.344763 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-a74f07ea-c883-4700-b31a-2e52869dafdb tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1576 microversion: 2.1 time: 0.197073 May 10 14:21:32.345370 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 547/1114] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:32 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 14:21:33.371018 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:33.371761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:33.378539 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.378994 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.379782 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:33.380225 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:33.523254 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:33.532397 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-3baf25de-02f2-448b-934a-117d8c97d6d0 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1576 microversion: 2.1 time: 0.166875 May 10 14:21:33.533409 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 568/1115] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:33 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:34.232859 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [req-ebe9ddbe-4f0e-4068-8705-c0eeb8e9313a req-6df6e0f2-b7ea-44ee-8ff2-73125ce19db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21d89cd9-9357-40e8-912a-aacd29e0250f", "name": "network-vif-deleted", "tag": "f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd"}]} {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 14:21:34.242010 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ebe9ddbe-4f0e-4068-8705-c0eeb8e9313a req-6df6e0f2-b7ea-44ee-8ff2-73125ce19db5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.242477 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [req-ebe9ddbe-4f0e-4068-8705-c0eeb8e9313a req-6df6e0f2-b7ea-44ee-8ff2-73125ce19db5 service nova] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.255270 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.compute.server_external_events [req-ebe9ddbe-4f0e-4068-8705-c0eeb8e9313a req-6df6e0f2-b7ea-44ee-8ff2-73125ce19db5 service nova] Creating event network-vif-deleted:f0d02c5e-a3e0-4ee5-92d5-48df324bd6dd for instance 21d89cd9-9357-40e8-912a-aacd29e0250f on hv-cinder-83588 May 10 14:21:34.264169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [req-ebe9ddbe-4f0e-4068-8705-c0eeb8e9313a req-6df6e0f2-b7ea-44ee-8ff2-73125ce19db5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032251 May 10 14:21:34.264169 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 548/1116] 10.222.0.32 () {64 vars in 1317 bytes} [Tue May 10 14:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 14:21:34.551525 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:34.552144 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:34.559492 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.559953 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.560739 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.561176 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.596482 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:34.596927 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:34.597383 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.objects.instance [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lazy-loading 'fault' on Instance uuid 21d89cd9-9357-40e8-912a-aacd29e0250f {{(pid=117186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 14:21:34.641682 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.policy [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9685af6f6f47c8a59fb93df9bd0ec1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6350c410027a478988e364b17696da95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117186) authorize /opt/stack/nova/nova/policy.py:199}} May 10 14:21:34.649775 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-79278400-9a28-4182-84e2-0f9e73638040 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 200 len: 1231 microversion: 2.1 time: 0.102199 May 10 14:21:34.651212 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 569/1117] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:34 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 14:21:35.671754 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:35.672463 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 21d89cd9-9357-40e8-912a-aacd29e0250f] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:35.679480 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.679932 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.680717 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:35.681155 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:35.696347 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] HTTP exception thrown: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Request method failure captured: May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f HTTP/1.1 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienL2NnrYT5F7KUoDFS1gtWw8idP-pytSjh3HooGNi8y2-bRe_KUDm94O9hnxzyn99mZLb4Qc2qqRnRBCv5VJV45_LasehH7RD2ZNe_PsaJJTAXoiROVT2TGpN5W23wwdi3ZYeIFO4avCbYPTyji6GqbETtxVt-U3ufAvIIuqKvybic4 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 6350c410027a478988e364b17696da95 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:21:35.698766 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/6350c410027a478988e364b17696da95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_6350c410027a478988e364b17696da95", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-TestVolumeBootPattern-993200433 May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 6350c410027a478988e364b17696da95 May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: da9685af6f6f47c8a59fb93df9bd0ec1 May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. May 10 14:21:35.700374 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '21d89cd9-9357-40e8-912a-aacd29e0250f'} May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:35.701220 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. May 10 14:21:35.702937 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:35.705752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Returning 404 to user: Instance 21d89cd9-9357-40e8-912a-aacd29e0250f could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:35.705752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-6fb6b631-deec-47de-a8c3-ae320c78f264 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f" status: 404 len: 111 microversion: 2.1 time: 0.035727 May 10 14:21:35.705752 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 549/1118] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:35 2022] GET /compute/v2.1/servers/21d89cd9-9357-40e8-912a-aacd29e0250f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:36.201918 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:36.202567 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.compute.api [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117186) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:36.209086 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.209639 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.210356 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.210789 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG oslo_concurrency.lockutils [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.227719 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.wsgi [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] HTTP exception thrown: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Request method failure captured: May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: request: DELETE /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 HTTP/1.1 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept: application/json May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Accept-Encoding: identity May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Connection: close May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Length: 0 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Content-Type: application/json May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Host: 10.222.0.32 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Openstack-System-Scope: None May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: User-Agent: python-urllib3/1.26.9 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Auth-Token: gAAAAABienL2NnrYT5F7KUoDFS1gtWw8idP-pytSjh3HooGNi8y2-bRe_KUDm94O9hnxzyn99mZLb4Qc2qqRnRBCv5VJV45_LasehH7RD2ZNe_PsaJJTAXoiROVT2TGpN5W23wwdi3ZYeIFO4avCbYPTyji6GqbETtxVt-U3ufAvIIuqKvybic4 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Id: None May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Domain-Name: None May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Identity-Status: Confirmed May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Is-Admin-Project: True May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Id: default May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Domain-Name: Default May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Id: 6350c410027a478988e364b17696da95 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Project-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Role: reader,member May 10 14:21:36.229975 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Roles: reader,member May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/6350c410027a478988e364b17696da95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_6350c410027a478988e364b17696da95", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Id: 6350c410027a478988e364b17696da95 May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-Tenant-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Id: default May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Domain-Name: Default May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Id: da9685af6f6f47c8a59fb93df9bd0ec1 May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: X-User-Name: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: method: > May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: exception: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.231761 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: action_args: {'id': '4446a4d1-9645-42b8-96b5-d61f47d6f420'} May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:36.232760 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.234372 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: ERROR nova.api.openstack.wsgi May 10 14:21:36.236333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Returning 404 to user: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. {{(pid=117186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:36.236333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-ad7313c5-a5f6-4e81-b662-d61f0e5de577 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 404 len: 111 microversion: 2.1 time: 0.033737 May 10 14:21:36.236333 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 570/1119] 10.222.0.32 () {58 vars in 1238 bytes} [Tue May 10 14:21:36 2022] DELETE /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:36.241337 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '>' {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:36.241969 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.compute.api [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] [instance: 4446a4d1-9645-42b8-96b5-d61f47d6f420] Fetching instance by UUID {{(pid=117185) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 14:21:36.249046 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.249506 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.250340 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 14:21:36.250786 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG oslo_concurrency.lockutils [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Lock "e5d8c375-2664-443d-97a4-224f3fe0d670" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117185) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 14:21:36.268530 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.wsgi [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] HTTP exception thrown: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Request method failure captured: May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: request: GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 HTTP/1.1 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept: application/json May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Accept-Encoding: identity May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Connection: close May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Length: 0 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Content-Type: application/json May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Host: 10.222.0.32 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Openstack-System-Scope: None May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: User-Agent: python-urllib3/1.26.9 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Auth-Token: gAAAAABienL2NnrYT5F7KUoDFS1gtWw8idP-pytSjh3HooGNi8y2-bRe_KUDm94O9hnxzyn99mZLb4Qc2qqRnRBCv5VJV45_LasehH7RD2ZNe_PsaJJTAXoiROVT2TGpN5W23wwdi3ZYeIFO4avCbYPTyji6GqbETtxVt-U3ufAvIIuqKvybic4 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Id: None May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Domain-Name: None May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Identity-Status: Confirmed May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Is-Admin-Project: True May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Id: default May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Domain-Name: Default May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Id: 6350c410027a478988e364b17696da95 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Project-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Role: reader,member May 10 14:21:36.270100 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Roles: reader,member May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2/6350c410027a478988e364b17696da95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/volume/v3/6350c410027a478988e364b17696da95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32:8080/v1/AUTH_6350c410027a478988e364b17696da95", "adminURL": "http://10.222.0.32:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.32/compute/v2.1"}]}] May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Id: 6350c410027a478988e364b17696da95 May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-Tenant-Name: tempest-TestVolumeBootPattern-993200433 May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Id: default May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Domain-Name: Default May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Id: da9685af6f6f47c8a59fb93df9bd0ec1 May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: X-User-Name: tempest-TestVolumeBootPattern-993200433-project May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: method: > May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: exception: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.271854 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: action_args: {'id': '4446a4d1-9645-42b8-96b5-d61f47d6f420'} May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: {{(pid=117185) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 14:21:36.272832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. May 10 14:21:36.274416 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: ERROR nova.api.openstack.wsgi May 10 14:21:36.276137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: DEBUG nova.api.openstack.wsgi [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Returning 404 to user: Instance 4446a4d1-9645-42b8-96b5-d61f47d6f420 could not be found. {{(pid=117185) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 14:21:36.276137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO nova.api.openstack.requestlog [None req-166176ea-b0b2-4fe6-b5b4-a2d7075e3bc8 tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420" status: 404 len: 111 microversion: 2.1 time: 0.034738 May 10 14:21:36.276137 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: [pid: 117185|app: 0|req: 550/1120] 10.222.0.32 () {58 vars in 1235 bytes} [Tue May 10 14:21:36 2022] GET /compute/v2.1/servers/4446a4d1-9645-42b8-96b5-d61f47d6f420 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 14:21:37.583346 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: DEBUG nova.api.openstack.wsgi [None req-f18cad17-bfad-4ea1-8459-d01f94e8f0fe tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] Calling method '.version_select at 0x7efd560a0160>' {{(pid=117186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 14:21:37.614985 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO nova.api.openstack.requestlog [None req-f18cad17-bfad-4ea1-8459-d01f94e8f0fe tempest-TestVolumeBootPattern-993200433 tempest-TestVolumeBootPattern-993200433-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2102038041" status: 202 len: 0 microversion: 2.1 time: 0.035092 May 10 14:21:37.615943 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: [pid: 117186|app: 0|req: 571/1121] 10.222.0.32 () {58 vars in 1262 bytes} [Tue May 10 14:21:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2102038041 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 14:21:49.779062 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:21:49.779804 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:23:17.163171 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:23:17.163832 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:24:15.706253 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:24:15.706914 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:24:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:25:09.787738 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:25:09.788566 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:26:37.171516 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:26:37.172097 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:26:45.917889 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:26:45.918595 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:26:54.930618 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:26:54.931212 dv-cinder-835881-9-iscsi devstack@n-api.service[117185]: Tue May 10 14:26:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 14:27:07.813119 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 14:27:07.813783 dv-cinder-835881-9-iscsi devstack@n-api.service[117186]: Tue May 10 14:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!